2020-07-01T10:15:41.469 INFO:root:teuthology version: 1.0.0-645528e 2020-07-01T10:15:41.471 INFO:teuthology.results:subset: '5/8' 2020-07-01T10:15:41.471 INFO:teuthology.results:seed: '5627' 2020-07-01T12:22:07.927 INFO:root:teuthology version: 1.0.0-645528e 2020-07-01T12:22:07.945 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-02T00:15:23.683 INFO:teuthology.results:Tests finished! gathering results... 2020-07-02T00:15:35.285 INFO:scrape:Found 99 jobs 2020-07-02T00:15:52.734 INFO:scrape:Found 15 distinct failure reasons 2020-07-02T00:15:52.736 INFO:scrape:Failure: Stale jobs detected, aborting. 2020-07-02T00:15:52.736 INFO:scrape:2 jobs: ['5193361', '5193404'] 2020-07-02T00:15:52.737 INFO:scrape:suites intersection: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.737 INFO:scrape:suites union: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/data-scan}', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.738 INFO:scrape: 2020-07-02T00:15:52.738 INFO:scrape:Failure: {'Failure object was': {'smithi077.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} 2020-07-02T00:15:52.739 INFO:scrape:11 jobs: ['5193465', '5193359', '5193435', '5193305', '5193325', '5193457', '5193416', '5193475', '5193384', '5193421', '5193445'] 2020-07-02T00:15:52.740 INFO:scrape:suites intersection: ['conf/{client', 'k-testing}', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.740 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-4-client', 'conf/{client', 'inline/no', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/recovery/{begin', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/acls-kernel-client}', 'tasks/backtrace}', 'tasks/failover}', 'tasks/kclient_workunit_o_trunc}', 'tasks/kclient_workunit_snaps}', 'tasks/kclient_workunit_suites_fsstress}', 'tasks/kclient_workunit_suites_iozone}', 'tasks/kclient_workunit_suites_pjd}', 'tasks/kclient_workunit_trivial_sync}', 'tasks/mds-flush}', 'thrash-health-whitelist', 'thrashers/default', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_iozone}'] 2020-07-02T00:15:52.741 INFO:scrape: 2020-07-02T00:15:52.741 INFO:scrape:Failure: Command failed on smithi058 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-07-02T00:15:52.748 INFO:scrape:10 jobs: ['5193446', '5193414', '5193370', '5193297', '5193380', '5193429', '5193469', '5193331', '5193441', '5193368'] 2020-07-02T00:15:52.749 INFO:scrape:suites intersection: ['conf/{client', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.750 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'clusters/1-mds-4-client', 'conf/{client', 'inline/no', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kcephfs/recovery/{begin', 'kclient-overrides/{distro/testing/{flavor/centos_latest', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/auto-repair}', 'tasks/data-scan}', 'tasks/kclient_workunit_misc}', 'tasks/kclient_workunit_o_trunc}', 'tasks/kclient_workunit_suites_ffsb}', 'tasks/kclient_workunit_suites_pjd}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/mds-full}', 'tasks/sessionmap}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.750 INFO:scrape: 2020-07-02T00:15:52.750 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi157.front.sepia.ceph.com: ['type=AVC msg=audit(1593605984.230:4635): avc: denied { module_request } for pid=18811 comm="ksmtuned" kmod="binfmt-464c" scontext=system_u:system_r:ksmtuned_t:s0 tcontext=system_u:system_r:kernel_t:s0 tclass=system permissive=1'] 2020-07-02T00:15:52.751 INFO:scrape:1 jobs: ['5193437'] 2020-07-02T00:15:52.751 INFO:scrape:suites: ['clusters/1-mds-1-client', 'conf/{client', 'inline/yes', 'kcephfs/cephfs/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/kclient_workunit_suites_dbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.752 INFO:scrape: 2020-07-02T00:15:52.753 INFO:scrape:Failure: Command failed on smithi064 with status 4: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.8.0_rc1_ceph_g556853900c89-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/556853900c89275f667d7cda681eca33c54b8e71/centos/8/flavors/default/x86_64/ --input-file=-' 2020-07-02T00:15:52.753 INFO:scrape:2 jobs: ['5193453', '5193396'] 2020-07-02T00:15:52.754 INFO:scrape:suites intersection: ['conf/{client', 'k-testing}', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.754 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'conf/{client', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kclient-overrides/{distro/testing/{flavor/ubuntu_latest', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/kclient_workunit_suites_fsync}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.755 INFO:scrape: 2020-07-02T00:15:52.755 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2020-07-02T00:15:52.756 INFO:scrape:1 jobs: ['5193431'] 2020-07-02T00:15:52.756 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.756 INFO:scrape: 2020-07-02T00:15:52.757 INFO:scrape:Failure: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',)) 2020-07-02T00:15:52.758 INFO:scrape:2 jobs: ['5193479', '5193433'] 2020-07-02T00:15:52.758 INFO:scrape:suites intersection: ['clusters/1-mds-1-client', 'conf/{client', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.759 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'conf/{client', 'inline/no', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/kclient_workunit_misc}', 'thrash-health-whitelist', 'thrashers/mds', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}'] 2020-07-02T00:15:52.760 INFO:scrape: 2020-07-02T00:15:52.760 INFO:scrape:Failure: HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200701.032245-octopus (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) 2020-07-02T00:15:52.761 INFO:scrape:11 jobs: ['5193477', '5193408', '5193410', '5193311', '5193420', '5193378', '5193419', '5193412', '5193467', '5193425', '5193386'] 2020-07-02T00:15:52.761 INFO:scrape:suites intersection: ['conf/{client', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.761 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'clusters/1-mds-4-client', 'conf/{client', 'inline/no', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kcephfs/recovery/{begin', 'kcephfs/thrash/{begin', 'kclient-overrides/{distro/testing/{flavor/ubuntu_latest', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/acls-kernel-client}', 'tasks/failover}', 'tasks/forward-scrub}', 'tasks/kclient_workunit_kernel_untar_build}', 'tasks/kclient_workunit_suites_iozone}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'thrash-health-whitelist', 'thrashers/mds', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_iozone}'] 2020-07-02T00:15:52.762 INFO:scrape: 2020-07-02T00:15:52.762 INFO:scrape:Failure: psutil.NoSuchProcess process no longer exists (pid=5763) 2020-07-02T00:15:52.763 INFO:scrape:2 jobs: ['5193402', '5193372'] 2020-07-02T00:15:52.763 INFO:scrape:suites intersection: ['clusters/1-mds-1-client', 'conf/{client', 'k-testing}', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.764 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'conf/{client', 'inline/no', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/kclient_workunit_suites_fsx}', 'thrash-health-whitelist', 'thrashers/default', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}'] 2020-07-02T00:15:52.764 INFO:scrape: 2020-07-02T00:15:52.765 INFO:scrape:Dead: b'2020-07-02T00:06:18.407 DEBUG:teuthology.exit:Finished running handlers' 2020-07-02T00:15:52.767 INFO:scrape:7 jobs: ['5193424', '5193443', '5193423', '5193394', '5193422', '5193451', '5193406'] 2020-07-02T00:15:52.768 INFO:scrape:suites intersection: ['conf/{client', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.768 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'clusters/1-mds-4-client', 'conf/{client', 'inline/no', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kcephfs/recovery/{begin', 'kcephfs/thrash/{begin', 'kclient-overrides/{distro/testing/{flavor/centos_latest', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/journal-repair}', 'tasks/kclient_workunit_direct_io}', 'tasks/kclient_workunit_kernel_untar_build}', 'tasks/kclient_workunit_suites_ffsb}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'thrash-health-whitelist', 'thrashers/mon', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}', 'workloads/kclient_workunit_suites_iozone}'] 2020-07-02T00:15:52.769 INFO:scrape: 2020-07-02T00:15:52.769 INFO:scrape:Dead: b'2020-07-01T23:09:08.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 6, have 2)...' 2020-07-02T00:15:52.775 INFO:scrape:4 jobs: ['5193319', '5193418', '5193398', '5193347'] 2020-07-02T00:15:52.775 INFO:scrape: 2020-07-02T00:15:52.776 INFO:scrape:Failure: Kernel mounts did not umount cleanly 2020-07-02T00:15:52.776 INFO:scrape:1 jobs: ['5193351'] 2020-07-02T00:15:52.777 INFO:scrape:suites: ['clusters/1-mds-1-client', 'conf/{client', 'k-testing}', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'thrash-health-whitelist', 'thrashers/mon', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_iozone}'] 2020-07-02T00:15:52.777 INFO:scrape: 2020-07-02T00:15:52.778 INFO:scrape:Failure: 'ssh_keyscan smithi197.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2020-07-02T00:15:52.778 INFO:scrape:1 jobs: ['5193390'] 2020-07-02T00:15:52.779 INFO:scrape: 2020-07-02T00:15:52.779 INFO:scrape:Failure: Command failed on smithi179 with status 1: 'sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm' 2020-07-02T00:15:52.780 INFO:scrape:1 jobs: ['5193392'] 2020-07-02T00:15:52.780 INFO:scrape:suites: ['clusters/1-mds-1-client', 'conf/{client', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/kclient_workunit_suites_dbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.780 INFO:scrape: 2020-07-02T00:15:52.781 INFO:scrape:Failure: SSH connection to smithi032 was lost: 'sudo lsb_release -is' 2020-07-02T00:15:52.781 INFO:scrape:1 jobs: ['5193376'] 2020-07-02T00:15:52.782 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/backtrace}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T00:15:52.782 INFO:scrape: 2020-07-02T00:15:52.793 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/ failed: 33 dead: 24 running: 0 waiting: 0 queued: 0 passed: 42 Fail ================================================================= [5193297] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:05:23 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193297/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193297/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d2c84614887044d9ab533d766c75f9b6 Command failed on smithi047 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5193311] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193311/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193311/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f0eb031ce1b3449b9b127ac019e29682 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=87e086aaee331e40e28c0493be2a7a3cd42478d5 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193331] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:18:13 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193331/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193331/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=77bbeeacff124a4498623fc10c1ce3ab Command failed on smithi096 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193351] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:21:01 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193351/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193351/ Kernel mounts did not umount cleanly [5193361] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193361/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193361/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8596e8c57aa44901be7cee73ef35db50 Stale jobs detected, aborting. [5193368] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} ----------------------------------------------------------------- time: 00:05:45 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193368/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193368/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f8fadcf5b6f84c049e31a2d28fb63754 Command failed on smithi172 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193370] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} ----------------------------------------------------------------- time: 00:05:41 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193370/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193370/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=18e6450801de40c6a0347ac3ceabcc10 Command failed on smithi184 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5193372] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 11:47:40 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193372/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193372/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a454c878777e4ab0952cd11b6b6bb746 psutil.NoSuchProcess process no longer exists (pid=25801) [5193378] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193378/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193378/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ae52001402b942cb8e3f774190e0797b HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=87e086aaee331e40e28c0493be2a7a3cd42478d5 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193380] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193380/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193380/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=45a3d43a063b4beaab3c74aaa6697021 Command failed on smithi104 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193386] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:22:34 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193386/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193386/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=12e36db6ee3f415fa5db52e2a50cbef2 HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-pdonnell-testing-20200701.032245-octopus /87e086aaee331e40e28c0493be2a7a3cd42478d5/centos/8/flavors/default/repo (Caused by SSLError(SSLError("bad handshake: SysCallError(110, 'ETIMEDOUT')",),)) [5193392] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193392/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193392/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b22f9e96c2c240cba61c5d77d401d2c3 Command failed on smithi179 with status 1: 'sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm' [5193396] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193396/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193396/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3e8c2be3eb984f8299dbfa6853a7e7a6 Command failed on smithi082 with status 4: 'rm -f /tmp/linux-image.deb && echo linux- image-5.8.0-rc1-ceph-g556853900c89_5.8.0-rc1-ceph-g556853900c89-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kerne l/testing/556853900c89275f667d7cda681eca33c54b8e71/ubuntu/bionic/flavors/de fault/pool/main/l/linux-5.8.0-rc1-ceph-g556853900c89/ --input-file=-' [5193402] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193402/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193402/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=466956400a32492e9f33afa67814c536 psutil.NoSuchProcess process no longer exists (pid=5763) [5193404] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193404/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193404/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=80485bdf57d14618ab76239a73ea7e3b Stale jobs detected, aborting. [5193408] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193408/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193408/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=698179a5c4874f4293c5a5db933c5036 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F18.04%2Fx86_64&ref=wip-pdonnell-testing-20200701.032245-octopus (Caused by SSLError(SSLError("bad handshake: SysCallError(110, 'ETIMEDOUT')",),)) [5193410] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193410/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193410/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e0e93a8f6c7a4b3a934a11378b2e877e HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=87e086aaee331e40e28c0493be2a7a3cd42478d5 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out',)) [5193412] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193412/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193412/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9701ea10e7cc477c99ffd6d2c02110e8 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=kernel&flavor=default&distros=ce ntos%2F8%2Fx86_64&sha1=556853900c89275f667d7cda681eca33c54b8e71 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193414] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:05:45 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193414/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193414/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ea929c88f41846e7a9c2a9adcb293926 Command failed on smithi155 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193419] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} ----------------------------------------------------------------- time: 00:06:30 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193419/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193419/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=44f88e4f9dfe4ed5923b3fb1128d5e22 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=87e086aaee331e40e28c0493be2a7a3cd42478d5 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193420] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193420/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193420/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1c0e1bae37424aeea17ba08b592bd327 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200701.032245-octopus (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193425] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193425/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193425/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e5608741417a4c728658aaf14429e5f5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200701.032245-octopus (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193429] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} ----------------------------------------------------------------- time: 00:09:31 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193429/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193429/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1f17ed6c627d41f79de79e764eb4c43b Command failed on smithi049 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193431] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:18:23 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193431/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193431/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=69bbe430027b4aae84d17fb503e2430e Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) [5193433] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193433/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193433/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=43d1e53f998c48f1912da23d04d354c1 ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',)) [5193437] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} ----------------------------------------------------------------- time: 01:01:11 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193437/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193437/ SELinux denials found on ubuntu@smithi157.front.sepia.ceph.com: ['type=AVC msg=audit(1593605984.230:4635): avc: denied { module_request } for pid=18811 comm="ksmtuned" kmod="binfmt-464c" scontext=system_u:system_r:ksmtuned_t:s0 tcontext=system_u:system_r:kernel_t:s0 tclass=system permissive=1'] [5193441] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193441/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193441/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1ad561c281ab425ca1914cb3e8ff8885 Command failed on smithi079 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel' [5193446] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193446/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193446/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=de2fe04beec648689d990dcb747676ce Command failed on smithi058 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5193453] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193453/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193453/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=78db126ec83c40e08ad1738f819c6978 Command failed on smithi064 with status 4: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.8.0_rc1_ceph_g556853900c89-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/55 6853900c89275f667d7cda681eca33c54b8e71/centos/8/flavors/default/x86_64/ --input-file=-' [5193467] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} ----------------------------------------------------------------- time: 00:05:14 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193467/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193467/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2f08bac10fcb4c068d710a8e23eb8401 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F18.04%2Fx86_64&sha1=87e086aaee331e40e28c0493be2a7a3cd42478d5 (Caused by SSLError(SSLError("bad handshake: SysCallError(104, 'ECONNRESET')",),)) [5193469] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193469/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193469/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4fd759ed17384458aed508fd1490a943 Command failed on smithi142 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5193477] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193477/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193477/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fa9adcdbfc854fad8fd51ea955791d2f HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200701.032245-octopus (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) [5193479] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193479/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193479/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3f44e5e22215450ca5490d078556fcb9 ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',)) Dead ================================================================= [5193305] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:03:36 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193305/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193305/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=04ef237aca604b3399b079e66635031c {'Failure object was': {'smithi035.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193319] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193319/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193319/ [5193325] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193325/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193325/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=16947030a0b74e00813155c87b23e99f {'Failure object was': {'smithi073.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193347] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193347/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193347/ [5193359] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:03:02 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193359/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193359/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3837bdcd707145e3a54cd6cda5079235 {'Failure object was': {'smithi134.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193376] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193376/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193376/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b11e5334550144ea9de4295dd91c9067 SSH connection to smithi032 was lost: 'sudo lsb_release -is' [5193384] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} ----------------------------------------------------------------- time: 00:02:38 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193384/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193384/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=35a4077077c145e3b11129b01cdb6a5f {'Failure object was': {'smithi140.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193390] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193390/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193390/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bed1818f47334eafa74769a7d0bc55c1 'ssh_keyscan smithi197.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds [5193394] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193394/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193394/ [5193398] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193398/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193398/ [5193406] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193406/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193406/ [5193416] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:02:54 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193416/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193416/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4587293fc10042daaed0023cc0d77869 {'Failure object was': {'smithi072.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193418] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193418/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193418/ [5193421] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:02:32 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193421/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193421/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b20b6a459d8d45718872fbb8b2cfddac {'Failure object was': {'smithi154.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193422] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193422/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193422/ [5193423] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193423/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193423/ [5193424] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193424/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193424/ [5193435] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} ----------------------------------------------------------------- time: 00:02:07 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193435/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193435/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3dc7eaaf2e0b48778838f64053afebeb {'Failure object was': {'smithi001.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193443] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193443/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193443/ [5193445] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:02:54 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193445/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193445/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2b9d397ad5724743aabca853bced727b {'Failure object was': {'smithi165.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193451] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193451/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193451/ [5193457] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:03:01 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193457/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193457/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c8a5e72847b3402597ad3e166d308c77 {'Failure object was': {'smithi148.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193465] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} ----------------------------------------------------------------- time: 00:02:46 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193465/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193465/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=26ff1282e2694ba18011755fb922d4b4 {'Failure object was': {'smithi077.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} [5193475] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} ----------------------------------------------------------------- time: 00:03:31 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193475/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193475/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a489649aed474f719826861b485064ac {'Failure object was': {'smithi159.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: ', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} Pass ================================================================= [5193295] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} time: 00:28:21 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193295/ [5193299] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb} time: 00:43:14 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193299/ [5193301] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} time: 00:13:03 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193301/ [5193303] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} time: 00:13:13 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193303/ [5193307] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:15:02 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193307/ [5193309] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} time: 00:11:48 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193309/ [5193313] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} time: 00:12:16 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193313/ [5193315] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:50:37 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193315/ [5193317] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone} time: 00:19:09 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193317/ [5193321] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:15:08 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193321/ [5193323] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} time: 00:53:01 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193323/ [5193327] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:29:21 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193327/ [5193329] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} time: 00:24:09 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193329/ [5193333] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb} time: 00:54:34 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193333/ [5193335] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} time: 00:59:18 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193335/ [5193337] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} time: 00:44:03 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193337/ [5193339] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} time: 00:15:03 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193339/ [5193341] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} time: 01:01:14 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193341/ [5193343] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:32:29 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193343/ [5193345] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} time: 00:15:10 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193345/ [5193349] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} time: 00:20:46 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193349/ [5193353] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} time: 00:15:45 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193353/ [5193355] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays} time: 00:31:39 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193355/ [5193357] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} time: 00:15:33 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193357/ [5193363] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} time: 00:14:06 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193363/ [5193365] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} time: 00:12:58 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193365/ [5193374] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:13:22 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193374/ [5193382] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:19:42 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193382/ [5193388] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} time: 01:42:12 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193388/ [5193400] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} time: 00:38:54 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193400/ [5193427] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:48:49 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193427/ [5193439] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} time: 00:24:55 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193439/ [5193449] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} time: 00:34:17 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193449/ [5193455] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays} time: 00:25:31 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193455/ [5193459] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:15:36 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193459/ [5193461] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} time: 00:26:03 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193461/ [5193463] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} time: 00:11:54 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193463/ [5193471] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb} time: 00:49:19 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193471/ [5193473] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:14:35 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193473/ [5193481] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:20:39 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193481/ [5193483] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} time: 00:25:10 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193483/ [5193485] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone} time: 00:30:38 info: http://pulpito.ceph.com/pdonnell-2020-07-01_06:41:02-kcephfs-wip-pdonnell-testing-20200701.032245-octopus-distro-basic-smithi/5193485/