Found 515 jobs Missing teuthology log /home/teuthworker/archive/teuthology-2021-03-08_03:30:03-rados-nautilus-distro-basic-gibba/5945492/teuthology.log Misunderstood line: Found 5 distinct failure reasons Failure: {'Failure object was': {'gibba021.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"} 119 jobs suites intersection: [] suites union: ['1-install/mimic', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-nautilus', '8-workload/{rbd-python', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/off', 'd-balancer/upmap', 'debug/mgr', 'fast/fast', 'fast/normal', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'msgr/random', 'msgr/simple', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/6', 'rados/objectstore/{backends/keyvaluedb', 'rados/objectstore/{backends/objectcacher-stress', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/divergent_priors', 'rados/singleton/{all/dump-stuck', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/osd-recovery', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/radostool', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/thrash-backfill-full', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/standalone/{supported-random-distro$/{rhel_7}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/mimic-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-random-distro$/{rhel_7}', 'supported-random-distro$/{rhel_7}}', 'tasks/dashboard}', 'tasks/mon_clock_with_skews}', 'tasks/rados_api_tests}', 'tasks/rados_stress_watch}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/ssh_orchestrator}', 'tasks/workunits}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps}', 'workloads/cache}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-radosbench}', 'workloads/ec-small-objects-overwrites}', 'workloads/erasure-code}', 'workloads/misc}', 'workloads/osd}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/set-chunks-read}', 'workloads/small-objects}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}'] Dead: None 20 jobs: ['5945492', '5945618', '5945324', '5945711', '5945460', '5945580', '5945367', '5945657', '5945385', '5945415', '5945540', '5945508', '5945637', '5945562', '5945694', '5945675', '5945705', '5945347', '5945439', '5945602'] Failure: Test failure: test_osd_came_back (tasks.mgr.test_progress.TestProgress) 1 jobs: ['5945532'] suites: ['debug/mgr', 'objectstore/bluestore-stupid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_latest}', 'tasks/progress}'] Valgrind: osd (InvalidRead) 1 jobs: ['5945621'] suites: ['clusters/{fixed-2', 'd-thrash/none', 'msgr-failures/few', 'msgr/async', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{ceph', 'tasks/mon_recovery', 'validater/valgrind}'] Failure: Command failed on gibba013 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' 1 jobs: ['5944912'] suites: ['msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton/{all/recovery-preemption', 'supported-random-distro$/{ubuntu_16.04}}']