Found 176 jobs Found 4 distinct failure reasons Failure: "2021-10-25T08:12:33.788820+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 31 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log 2 jobs: ['6460311', '6460288'] suites intersection: ['msgr-failures/few', 'openstack}'] suites union: ['clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/filestore-xfs', 'openstack}', 'policy/simple', 'pool/small-cache-pool', 'rbd-mirror/four-per-cluster', 'rbd/cli/{base/install', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd_cli_migration}'] Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 1 jobs: ['6460238'] suites: ['clusters/{fixed-1', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] Failure: Failure object was: {'smithi139.front.sepia.ceph.com': {'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" install \'docker.io\'\' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7902 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stdout': '', 'stderr': 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7902 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100, 'cache_updated': False, 'cache_update_time': 1635145084, 'invocation': {'module_args': {'name': ['docker.io'], 'state': 'latest', 'package': ['docker.io'], 'cache_valid_time': 0, 'purge': False, 'force': False, 'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'autoclean': False, 'only_upgrade': False, 'force_apt_get': False, 'allow_unauthenticated': False, 'update_cache': None, 'deb': None, 'default_release': None, 'install_recommends': None, 'upgrade': None, 'policy_rc_d': None}}, 'stdout_lines': [], 'stderr_lines': ['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7902 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time') 1 jobs: ['6460246'] suites: ['cachepool/small', 'clusters/{fixed-1', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd/basic/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rbd_python_api_tests_old_format}'] Failure: Command failed on smithi198 with status 1: 'test -n "$(ls /tmp/ceph-immutable-object-cache )"' 1 jobs: ['6460249'] suites: ['openstack}', 'pool/ceph_and_immutable_object_cache', 'rbd/immutable-object-cache/{clusters/{fix-2', 'supported-random-distro$/{ubuntu_latest}', 'workloads/qemu_on_immutable_object_cache_and_thrash}']