Found 240 jobs Missing teuthology log /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660957/teuthology.log Found 9 distinct failure reasons Failure: smithi162.front.sepia.ceph.com: _ansible_no_log: null changed: false failures: [] invocation: module_args: allow_downgrade: false allowerasing: false autoremove: false bugfix: false cacheonly: false conf_file: null disable_excludes: null disable_gpg_check: false disable_plugin: [] disablerepo: [] download_dir: null download_only: false enable_plugin: [] enablerepo: [] exclude: [] install_repoquery: true install_weak_deps: true installroot: / list: null lock_timeout: 30 name: - dnf-utils - sysstat - libedit - boost-thread - xfsprogs - gdisk - parted - libgcrypt - fuse-libs - openssl - libuuid - podman - attr - lsof - gettext - bc - xfsdump - blktrace - usbredir - valgrind - nfs-utils - ncurses-devel - gcc - git - genisoimage - qemu-img - qemu-kvm-core - qemu-kvm-block-rbd - libacl-devel - autoconf - gdb - iozone nobest: false releasever: null security: false skip_broken: false sslverify: true state: present update_cache: false update_only: false validate_certs: true msg: "Depsolve Error occurred: \n Problem: problem with installed package annobin-12.12-1.el9.x86_64\n\ \ - package annobin-12.12-1.el9.x86_64 from @System requires (gcc >= 11 with\ \ gcc < 12), but none of the providers can be installed\n - package annobin-12.09-1.el9.x86_64\ \ from appstream requires (gcc >= 11 with gcc < 12), but none of the providers\ \ can be installed\n - package annobin-12.12-1.el9.x86_64 from appstream requires\ \ (gcc >= 11 with gcc < 12), but none of the providers can be installed\n - package\ \ annobin-12.28-1.el9.x86_64 from appstream requires (gcc >= 11 with gcc < 12),\ \ but none of the providers can be installed\n - package annobin-12.31-1.el9.x86_64\ \ from appstream requires (gcc >= 11 with gcc < 12), but none of the providers\ \ can be installed\n - package annobin-12.31-2.el9.x86_64 from appstream requires\ \ (gcc >= 11 with gcc < 12), but none of the providers can be installed\n - cannot\ \ install both gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream and gcc-11.4.1-2.1.el9.x86_64\ \ from @System\n - cannot install both gcc-11.3.1-4.4.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - cannot install both\ \ gcc-11.4.1-2.1.el9.x86_64 from appstream and gcc-14.0.1-0.15.el10.x86_64 from\ \ CentOS-AppStream\n - cannot install both gcc-11.4.1-2.3.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - cannot install both\ \ gcc-11.4.1-2.el9.x86_64 from appstream and gcc-14.0.1-0.15.el10.x86_64 from\ \ CentOS-AppStream\n - cannot install both gcc-11.4.1-3.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - package gcc-c++-14.0.1-0.15.el10.x86_64\ \ from CentOS-AppStream requires gcc = 14.0.1-0.15.el10, but none of the providers\ \ can be installed\n - problem with installed package gcc-c++-11.4.1-2.1.el9.x86_64\n\ \ - package gcc-c++-11.4.1-2.1.el9.x86_64 from appstream requires libstdc++ =\ \ 11.4.1-2.1.el9, but none of the providers can be installed\n - package gcc-c++-11.4.1-2.1.el9.x86_64\ \ from @System requires libstdc++ = 11.4.1-2.1.el9, but none of the providers\ \ can be installed\n - package gcc-c++-11.3.1-4.4.el9.x86_64 from appstream requires\ \ libstdc++ = 11.3.1-4.4.el9, but none of the providers can be installed\n -\ \ package gcc-c++-11.4.1-2.3.el9.x86_64 from appstream requires libstdc++ = 11.4.1-2.3.el9,\ \ but none of the providers can be installed\n - package gcc-c++-11.4.1-2.el9.x86_64\ \ from appstream requires libstdc++ = 11.4.1-2.el9, but none of the providers\ \ can be installed\n - package gcc-c++-11.4.1-3.el9.x86_64 from appstream requires\ \ libstdc++ = 11.4.1-3.el9, but none of the providers can be installed\n - libstdc++-11.4.1-2.1.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.3.1-4.4.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-2.3.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-2.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-3.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - cannot install\ \ both libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS and libstdc++-11.4.1-2.1.el9.x86_64\ \ from @System\n - cannot install both libstdc++-11.3.1-4.4.el9.x86_64 from baseos\ \ and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - cannot install\ \ both libstdc++-11.4.1-2.1.el9.x86_64 from baseos and libstdc++-14.0.1-0.15.el10.x86_64\ \ from CentOS-BaseOS\n - cannot install both libstdc++-11.4.1-2.3.el9.x86_64\ \ from baseos and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - cannot\ \ install both libstdc++-11.4.1-2.el9.x86_64 from baseos and libstdc++-14.0.1-0.15.el10.x86_64\ \ from CentOS-BaseOS\n - cannot install both libstdc++-11.4.1-3.el9.x86_64 from\ \ baseos and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - package\ \ python3-hawkey-0.73.0-1.el10.x86_64 from CentOS-BaseOS requires libstdc++.so.6(GLIBCXX_3.4.30)(64bit),\ \ but none of the providers can be installed\n - package python3-dnf-4.19.0-2.el10.noarch\ \ from CentOS-BaseOS requires python3-hawkey >= 0.73.0, but none of the providers\ \ can be installed\n - package yum-utils-4.5.0-1.el10.noarch from CentOS-BaseOS\ \ requires python3-dnf >= 4.19.0, but none of the providers can be installed\n\ \ - cannot install the best candidate for the job" rc: 1 results: []smithi043.front.sepia.ceph.com: _ansible_no_log: null changed: false failures: [] invocation: module_args: allow_downgrade: false allowerasing: false autoremove: false bugfix: false cacheonly: false conf_file: null disable_excludes: null disable_gpg_check: false disable_plugin: [] disablerepo: [] download_dir: null download_only: false enable_plugin: [] enablerepo: [] exclude: [] install_repoquery: true install_weak_deps: true installroot: / list: null lock_timeout: 30 name: - dnf-utils - sysstat - libedit - boost-thread - xfsprogs - gdisk - parted - libgcrypt - fuse-libs - openssl - libuuid - podman - attr - lsof - gettext - bc - xfsdump - blktrace - usbredir - valgrind - nfs-utils - ncurses-devel - gcc - git - genisoimage - qemu-img - qemu-kvm-core - qemu-kvm-block-rbd - libacl-devel - autoconf - gdb - iozone nobest: false releasever: null security: false skip_broken: false sslverify: true state: present update_cache: false update_only: false validate_certs: true msg: "Depsolve Error occurred: \n Problem: problem with installed package annobin-12.12-1.el9.x86_64\n\ \ - package annobin-12.12-1.el9.x86_64 from @System requires (gcc >= 11 with\ \ gcc < 12), but none of the providers can be installed\n - package annobin-12.09-1.el9.x86_64\ \ from appstream requires (gcc >= 11 with gcc < 12), but none of the providers\ \ can be installed\n - package annobin-12.12-1.el9.x86_64 from appstream requires\ \ (gcc >= 11 with gcc < 12), but none of the providers can be installed\n - package\ \ annobin-12.28-1.el9.x86_64 from appstream requires (gcc >= 11 with gcc < 12),\ \ but none of the providers can be installed\n - package annobin-12.31-1.el9.x86_64\ \ from appstream requires (gcc >= 11 with gcc < 12), but none of the providers\ \ can be installed\n - package annobin-12.31-2.el9.x86_64 from appstream requires\ \ (gcc >= 11 with gcc < 12), but none of the providers can be installed\n - cannot\ \ install both gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream and gcc-11.4.1-2.1.el9.x86_64\ \ from @System\n - cannot install both gcc-11.3.1-4.4.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - cannot install both\ \ gcc-11.4.1-2.1.el9.x86_64 from appstream and gcc-14.0.1-0.15.el10.x86_64 from\ \ CentOS-AppStream\n - cannot install both gcc-11.4.1-2.3.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - cannot install both\ \ gcc-11.4.1-2.el9.x86_64 from appstream and gcc-14.0.1-0.15.el10.x86_64 from\ \ CentOS-AppStream\n - cannot install both gcc-11.4.1-3.el9.x86_64 from appstream\ \ and gcc-14.0.1-0.15.el10.x86_64 from CentOS-AppStream\n - package gcc-c++-14.0.1-0.15.el10.x86_64\ \ from CentOS-AppStream requires gcc = 14.0.1-0.15.el10, but none of the providers\ \ can be installed\n - problem with installed package gcc-c++-11.4.1-2.1.el9.x86_64\n\ \ - package gcc-c++-11.4.1-2.1.el9.x86_64 from appstream requires libstdc++ =\ \ 11.4.1-2.1.el9, but none of the providers can be installed\n - package gcc-c++-11.4.1-2.1.el9.x86_64\ \ from @System requires libstdc++ = 11.4.1-2.1.el9, but none of the providers\ \ can be installed\n - package gcc-c++-11.3.1-4.4.el9.x86_64 from appstream requires\ \ libstdc++ = 11.3.1-4.4.el9, but none of the providers can be installed\n -\ \ package gcc-c++-11.4.1-2.3.el9.x86_64 from appstream requires libstdc++ = 11.4.1-2.3.el9,\ \ but none of the providers can be installed\n - package gcc-c++-11.4.1-2.el9.x86_64\ \ from appstream requires libstdc++ = 11.4.1-2.el9, but none of the providers\ \ can be installed\n - package gcc-c++-11.4.1-3.el9.x86_64 from appstream requires\ \ libstdc++ = 11.4.1-3.el9, but none of the providers can be installed\n - libstdc++-11.4.1-2.1.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.3.1-4.4.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-2.3.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-2.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - libstdc++-11.4.1-3.el9.i686\ \ from baseos does not belong to a distupgrade repository\n - cannot install\ \ both libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS and libstdc++-11.4.1-2.1.el9.x86_64\ \ from @System\n - cannot install both libstdc++-11.3.1-4.4.el9.x86_64 from baseos\ \ and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - cannot install\ \ both libstdc++-11.4.1-2.1.el9.x86_64 from baseos and libstdc++-14.0.1-0.15.el10.x86_64\ \ from CentOS-BaseOS\n - cannot install both libstdc++-11.4.1-2.3.el9.x86_64\ \ from baseos and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - cannot\ \ install both libstdc++-11.4.1-2.el9.x86_64 from baseos and libstdc++-14.0.1-0.15.el10.x86_64\ \ from CentOS-BaseOS\n - cannot install both libstdc++-11.4.1-3.el9.x86_64 from\ \ baseos and libstdc++-14.0.1-0.15.el10.x86_64 from CentOS-BaseOS\n - package\ \ python3-hawkey-0.73.0-1.el10.x86_64 from CentOS-BaseOS requires libstdc++.so.6(GLIBCXX_3.4.30)(64bit),\ \ but none of the providers can be installed\n - package python3-dnf-4.19.0-2.el10.noarch\ \ from CentOS-BaseOS requires python3-hawkey >= 0.73.0, but none of the providers\ \ can be installed\n - package yum-utils-4.5.0-1.el10.noarch from CentOS-BaseOS\ \ requires python3-dnf >= 4.19.0, but none of the providers can be installed\n\ \ - cannot install the best candidate for the job" rc: 1 results: [] 162 jobs suites intersection: [] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '1-mount', '1-ranks/1', '1-ranks/2', '1-rename', '1-tests/fscrypt-iozone}}', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '2-client/kclient', '2-logrotate', '2-scrub/no', '2-scrub/yes', '2-three-per-cluster}', '2-workload/dbench', '2-workunit/cfuse_workunit_snaptests}}', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/ffsb}}', '2-workunit/fs/snaps}}', '2-workunit/fs/trivial_sync}}', '2-workunit/iozone}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/iozone}}', '2-workunit/suites/pjd}}', '3-inline/no', '3-inline/yes', '3-modules}', '3-snaps/no', '3-snaps/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-flush/no', '4-flush/yes', '4-verify}', '5-upgrade-with-workload', '5-workunit/direct_io}}', '5-workunit/fs/misc}}', '5-workunit/fs/norstats}}', '5-workunit/fs/test_o_trunc}}', '5-workunit/kernel_untar_build}}', '5-workunit/postgres}}', '5-workunit/suites/blogbench}}', '5-workunit/suites/dbench}}', '5-workunit/suites/ffsb}}', '5-workunit/suites/fsstress}}', '5-workunit/suites/fsx}}', '5-workunit/suites/fsync-tester}}', '5-workunit/suites/iogen}}', '5-workunit/suites/iozone}}', '5-workunit/suites/pjd}}', '6-verify}}', 'begin/{0-install', 'bluestore-bitmap', 'centos_9.stream', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'cephfs-mirror/{1-volume-create-rm', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'clusters/1-mds-1-client', 'clusters/1-mds-1-client-coloc', 'clusters/1-node-1-mds-1-osd', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/small-cluster', 'conf/{client', 'debug', 'distro/single-container-host', 'distro/{centos_latest}', 'distro/{ubuntu/{overrides', 'distro/{ubuntu_latest}', 'export-check', 'fail_fs/no', 'fail_fs/yes', 'frag', 'fs/32bits/{begin/{0-install', 'fs/bugs/client_trim_caps/{begin/{0-install', 'fs/cephadm/multivolume/{0-start', 'fs/cephadm/renamevolume/{0-start', 'fs/fscrypt/{begin/{0-install', 'fs/full/{begin/{0-install', 'fs/functional/{begin/{0-install', 'fs/libcephfs/{begin/{0-install', 'fs/mirror-ha/{begin/{0-install', 'fs/mirror/{begin/{0-install', 'fs/mixed-clients/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/snaps/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/traceless/{begin/{0-install', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'fs/valgrind/{begin/{0-install', 'fs/verify/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_health_more', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'k-stock}', 'kclient-overrides/{distro/stock/{centos_9.stream', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mgr', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v1}', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{k-testing', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'n/3', 'n/5', 'no_client_pidfile', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd', 'osd-asserts', 'osd}', 'overrides', 'overrides/{cephsqlite-timeout', 'overrides/{client-shutdown', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{faked-ino', 'overrides/{frag', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'pg_health}', 'pg_health}}', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'ranks/multi/{balancer/automatic', 'ranks/multi/{balancer/random', 'replication/always}', 'replication/default}', 'roles', 'session_timeout', 'session_timeout}', 'standby-replay', 'subvol_versions/create_subvol_version_v1', 'subvol_versions/create_subvol_version_v2', 'supported-random-distro$/{centos_latest}', 'supported-random-distros$/{centos_latest}', 'syntax}', 'tasks/acls}', 'tasks/admin}', 'tasks/alternate-pool}', 'tasks/asok_dump_tree}', 'tasks/auto-repair}', 'tasks/backtrace}', 'tasks/cap-flush}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/client-limits}', 'tasks/client-recovery}', 'tasks/client}', 'tasks/damage}', 'tasks/data-scan}', 'tasks/dbench', 'tasks/exports}', 'tasks/failover}', 'tasks/forward-scrub}', 'tasks/fsstress', 'tasks/ino_release_cb}', 'tasks/journal-repair}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/mds-flush}', 'tasks/mds-full}', 'tasks/mds_creation_retry}', 'tasks/mgr-osd-full}', 'tasks/mirror}', 'tasks/mirror}}', 'tasks/multifs-auth}', 'tasks/openfiletable}', 'tasks/pool-perm}', 'tasks/quota}', 'tasks/recovery-fs}', 'tasks/scrub}', 'tasks/sessionmap}', 'tasks/snapshots}', 'tasks/strays}', 'tasks/trim-i24137}', 'tasks/truncate_delay}', 'tasks/volumes/{overrides', 'tasks/workunit/quota}', 'tasks/workunit/snaps}', 'tasks/{0-client', 'tasks/{0-from/quincy', 'tasks/{0-from/reef/{reef}', 'tasks/{0-from/reef/{v18.2.0}', 'tasks/{0-from/reef/{v18.2.1}', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-subvolume/{with-namespace-isolated}', 'tasks/{0-subvolume/{with-no-extra-options}', 'tasks/{0-subvolume/{with-quota}', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'test/basic}}', 'test/finisher_per_module}}', 'test/misc}}', 'thrashosds-health}', 'traceless/50pc}', 'ubuntu_latest}}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/cephfs-mirror-ha-workunit}', 'wsync/no}', 'wsync/yes}'] Failure: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 1 jobs: ['7660928'] suites: ['1-ceph', '2-logrotate', '3-modules}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/ubuntu_latest', 'fs/shell/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/cephfs-shell}'] Dead: None 5 jobs: ['7660957', '7660958', '7660953', '7660952', '7660807'] Failure: Command failed on smithi057 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2c deep-scrub' 2 jobs: ['7660774', '7660895'] suites intersection: ['1-client', '2-upgrade', '3-compat_client/quincy}}', 'centos_8.stream', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'multimds/no', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{0-octopus'] suites union: ['1-client', '2-upgrade', '3-compat_client/quincy}}', 'centos_8.stream', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'multimds/no', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{0-octopus'] Failure: ['Data could not be sent to remote host "smithi139.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi139.front.sepia.ceph.com port 22: No route to host'] 2 jobs: ['7660945', '7660980'] suites intersection: ['1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-modules}', '3-snaps/no', '4-flush/no', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'n/5', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'pg_health', 'session_timeout}', 'standby-replay', 'wsync/no}'] suites union: ['1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-modules}', '3-snaps/no', '4-flush/no', '5-workunit/kernel_untar_build}}', '5-workunit/suites/iogen}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'pg_health', 'ranks/multi/{balancer/automatic', 'ranks/multi/{balancer/random', 'replication/always}', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/no}'] Failure: ['Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'] 1 jobs: ['7660977'] suites: ['1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '3-modules}', '3-snaps/yes', '4-flush/yes', '5-workunit/fs/test_o_trunc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'n/5', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'pg_health', 'ranks/multi/{balancer/automatic', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}'] Failure: SSH connection to smithi007 was lost: 'sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm' 2 jobs: ['7660789', '7660790'] suites intersection: ['2-logrotate', '3-modules}', 'conf/{client', 'frag', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/k-testing', 'pg_health'] suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '2-workunit/cfuse_workunit_snaptests}}', '3-modules}', '3-snaps/no', '4-flush/no', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'frag', 'fs/thrash/multifs/{begin/{0-install', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{client-shutdown', 'overrides/{distro/testing/k-testing', 'pg_health', 'ranks/1', 'session_timeout', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}', 'tasks/{1-thrash/mon', 'thrashosds-health}', 'wsync/no}'] Failure: Command failed on smithi045 with status 1: 'sudo yum install -y kernel' 1 jobs: ['7660787'] suites: ['1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-modules}', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/blogbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'pg_health', 'ranks/multi/{balancer/automatic', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}'] Failure: "2024-04-18T09:03:17.916159+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log 1 jobs: ['7660805'] suites: ['conf/{client', 'fs/nfs/{cluster/{1-node}', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/nfs}']