Found 368 jobs Found 8 distinct failure reasons Failure: SELinux denials found on ubuntu@smithi092.front.sepia.ceph.com: ['type=AVC msg=audit(1657251171.215:18210): avc: denied { ioctl } for pid=110078 comm="iptables" path="/var/lib/containers/storage/overlay/7f8dbe6bccbe88182c490441f7b093806a470b64174353fb19b8eed1dc49c6e2/merged" dev="overlay" ino=3541260 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1657251171.066:18208): avc: denied { ioctl } for pid=110049 comm="iptables" path="/var/lib/containers/storage/overlay/7f8dbe6bccbe88182c490441f7b093806a470b64174353fb19b8eed1dc49c6e2/merged" dev="overlay" ino=3541260 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 1 jobs: ['6916562'] suites: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] Crash: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on smithi037 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=297f944c54c8d8b03d4faee671f8bb06163c8262 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' ceph version 15.2.16-318-g297f944c (297f944c54c8d8b03d4faee671f8bb06163c8262) octopus (stable) 1: (()+0x12ce0) [0x7ff7f8f19ce0] 2: (gsignal()+0x10f) [0x7ff7f756ba9f] 3: (abort()+0x127) [0x7ff7f753ee05] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7ff7f9d25c93] 5: (()+0x27de5c) [0x7ff7f9d25e5c] 6: (BlueStore::_mount_for_bluefs()+0x68) [0x55d169d4c618] 7: (BlueStore::migrate_to_existing_bluefs_device(std::set, std::allocator > const&, int)+0x1a0) [0x55d169d4ff20] 8: (main()+0x4144) [0x55d169c42d54] 9: (__libc_start_main()+0xf3) [0x7ff7f7557cf3] 10: (_start()+0x2e) [0x55d169c62efe] 1 jobs: ['6916371'] suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/osd}'] Failure: Test failure: test_health_history (tasks.mgr.test_insights.TestInsights) 1 jobs: ['6916486'] suites: ['debug/mgr', 'objectstore/bluestore-comp-lz4', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'tasks/insights}'] Timeout 120 running ceph --cluster ceph pg dump --format=json 1 jobs: ['6916304'] suites: ['msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_18.04}}'] Dead: b'2022-07-08T13:41:10.287 DEBUG:teuthology.exit:Finished running handlers' 1 jobs: ['6916364'] suites: ['msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/thrash-eio', 'supported-random-distro$/{centos_8}}'] Failure: Test failure: test_pool_create_with_compression (tasks.mgr.dashboard.test_pool.PoolTest) 1 jobs: ['6916350'] suites: ['debug/mgr', 'objectstore/bluestore-low-osd-mem-target', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] Failure: reached maximum tries (800) after waiting for 4800 seconds 1 jobs: ['6916399'] suites: ['clusters/{fixed-2', 'fast/fast', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{ubuntu_18.04}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-radosbench}'] Failure: "2022-07-08T02:01:09.756151+0000 mon.a (mon.0) 1325 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log 1 jobs: ['6916359'] suites: ['clusters/3-mons', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_18.04}', 'thrashers/one', 'workloads/rados_mon_workunits}']