2023-01-27T01:12:27.225 INFO:root:teuthology version: 0.0.1.dev31+g912c45c 2023-01-27T01:12:27.282 INFO:teuthology.results:subset: '111/120000' 2023-01-27T01:12:27.282 INFO:teuthology.results:seed: '112' 2023-01-27T07:07:36.645 INFO:root:teuthology version: 0.0.1.dev33+gbf44874 2023-01-27T07:07:36.689 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-01-27T10:24:52.776 INFO:teuthology.results:Tests finished! gathering results... 2023-01-27T10:25:07.152 INFO:scrape:Found 182 jobs 2023-01-27T10:25:45.528 INFO:scrape:Found 13 distinct failure reasons 2023-01-27T10:25:45.529 INFO:scrape:Failure: "2023-01-27T02:31:58.955634+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log 2023-01-27T10:25:45.530 INFO:scrape:81 jobs 2023-01-27T10:25:45.531 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.531 INFO:scrape:suites union: ['2-cluster/{fix-2', '2-clusters/{fixed-3', '3-objectstore/bluestore-comp-snappy', '3-objectstore/bluestore-comp-zlib', '3-objectstore/bluestore-comp-zstd', '3-objectstore/bluestore-hybrid', '3-objectstore/bluestore-low-osd-mem-target', '3-objectstore/bluestore-stupid', '3-supported-random-distro$/{centos_8}', '3-supported-random-distro$/{rhel_8}', '4-cache-path', '4-supported-random-distro$/{centos_8}', '4-supported-random-distro$/{rhel_8}', '5-cache-mode/rwl', '5-cache-mode/ssd', '5-pool/ec-data-pool', '5-pool/none', '5-pool/replicated-data-pool', '6-cache-size/1G', '6-cache-size/5G', '6-cache-size/8G', '6-prepare/qcow2-file', '6-prepare/qcow2-http', '6-prepare/raw-file', '7-io-workloads/qemu_xfstests', '7-workloads/c_api_tests_with_defaults}', '7-workloads/qemu_xfstests}', '7-workloads/recovery}', '8-migrate-workloads/execute', '9-cleanup/cleanup}', 'cachepool/none', 'cachepool/small', 'centos_latest', 'clients/mirror', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'clusters/{fixed-2', 'clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'features/defaults', 'features/format-1', 'features/journaling', 'features/layering', 'features/readbalance', 'min-compat-client/default', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/none', 'pool/ceph_and_immutable_object_cache', 'pool/ec-cache-pool', 'pool/ec-data-pool', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'qemu/xfstests', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'rbd/encryption/{cache/none', 'rbd/encryption/{cache/writearound', 'rbd/encryption/{cache/writeback', 'rbd/encryption/{cache/writethrough', 'rbd/immutable-object-cache/{clusters/{fix-2', 'rbd/librbd/{cache/none', 'rbd/librbd/{cache/writeback', 'rbd/librbd/{cache/writethrough', 'rbd/maintenance/{base/install', 'rbd/migration/{1-base/install', 'rbd/mirror-thrash/{base/install', 'rbd/nbd/{base/install', 'rbd/pwl-cache/home/{1-base/install', 'rbd/pwl-cache/tmpfs/{1-base/install', 'rbd/qemu/{cache/none', 'rbd/qemu/{cache/writearound', 'rbd/qemu/{cache/writeback', 'rbd/qemu/{cache/writethrough', 'rbd/singleton-bluestore/{all/issue-20295', 'rbd/singleton/{all/qos', 'rbd/singleton/{all/rbd_mirror', 'rbd/thrash/{base/install', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_python_api_tests_old_format}', 'thrashers/cache', 'thrashers/default', 'thrashosds-health', 'validator/memcheck', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}', 'workloads/dynamic_features_no_cache}', 'workloads/dynamic_features}', 'workloads/fio_on_immutable_object_cache}', 'workloads/journal}', 'workloads/python_api_tests_with_defaults}', 'workloads/python_api_tests_with_journaling}', 'workloads/python_api_tests}', 'workloads/qemu_bonnie}', 'workloads/qemu_fsstress}', 'workloads/qemu_on_immutable_object_cache_and_thrash}', 'workloads/qemu_xfstests_luks1}', 'workloads/qemu_xfstests_luks2}', 'workloads/qemu_xfstests}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd_api_tests_copy_on_read}', 'workloads/rbd_api_tests_no_locking}', 'workloads/rbd_api_tests}', 'workloads/rbd_cli_generic}', 'workloads/rbd_cli_migration}', 'workloads/rbd_fio}', 'workloads/rbd_fsx_cache_writearound}', 'workloads/rbd_fsx_cache_writeback}', 'workloads/rbd_fsx_cache_writethrough}', 'workloads/rbd_fsx_deep_copy}', 'workloads/rbd_fsx_nbd}', 'workloads/rbd_fsx_nocache}', 'workloads/rbd_fsx_rate_limit}', 'workloads/rbd_mirror}', 'workloads/rebuild_object_map}'] 2023-01-27T10:25:45.532 INFO:scrape: 2023-01-27T10:25:45.532 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674794432.272:14038): avc: denied { open } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.273:14040): avc: denied { map } for pid=77374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794431.909:14035): avc: denied { search } for pid=1821 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674794432.273:14039): avc: denied { lock } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.272:14038): avc: denied { read } for pid=77374 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.532 INFO:scrape:7 jobs: ['7139422', '7139414', '7139415', '7139330', '7139442', '7139327', '7139421'] 2023-01-27T10:25:45.533 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.533 INFO:scrape:suites union: ['centos_latest', 'clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'features/format-1', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/simple', 'pool/small-cache-pool', 'rbd-mirror/four-per-cluster', 'rbd/cli_v1/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'rbd/nbd/{base/install', 'rbd/singleton/{all/qemu-iotests-no-cache', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'validator/memcheck', 'workloads/fsx}', 'workloads/rbd-mirror-journal-bootstrap-workunit}', 'workloads/rbd-mirror-journal-stress-workunit}', 'workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}', 'workloads/rbd_cli_import_export}', 'workloads/rbd_nbd}'] 2023-01-27T10:25:45.534 INFO:scrape: 2023-01-27T10:25:45.534 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674799269.564:15026): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.219:15001): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15025): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.940:19432): avc: denied { map } for pid=87059 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19431): avc: denied { lock } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799779.815:19618): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19668): avc: denied { lock } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { read } for pid=87059 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { read } for pid=6999 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { open } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:420): avc: denied { lock } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:421): avc: denied { map } for pid=6999 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { open } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19669): avc: denied { map } for pid=90420 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799681.565:19429): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { read } for pid=90420 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { open } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.535 INFO:scrape:8 jobs: ['7139456', '7139449', '7139454', '7139485', '7139407', '7139431', '7139458', '7139333'] 2023-01-27T10:25:45.535 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.535 INFO:scrape:suites union: ['cachepool/small', 'clients/mirror', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack', 'openstack}', 'policy/none', 'policy/simple', 'pool/ec-data-pool', 'pool/small-cache-pool', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/nbd/{base/install', 'rbd/singleton/{all/qemu-iotests-writeback', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'tasks/rbd_lock_and_fence}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd-mirror-journal-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd_cli_import_export}', 'workloads/rbd_nbd}'] 2023-01-27T10:25:45.536 INFO:scrape: 2023-01-27T10:25:45.536 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi165.front.sepia.ceph.com: ['type=AVC msg=audit(1674786749.098:15025): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786748.752:15002): avc: denied { search } for pid=6922 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674786749.098:15024): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.537 INFO:scrape:5 jobs: ['7139358', '7139432', '7139394', '7139371', '7139365'] 2023-01-27T10:25:45.537 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.537 INFO:scrape:suites union: ['cachepool/none', 'clients/{mirror-extra', 'cluster/{2-node', 'clusters/{fixed-1', 'features/format-1', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-stupid', 'openstack', 'openstack}', 'pool/small-cache-pool', 'rbd/basic/{base/install', 'rbd/cli_v1/{base/install', 'rbd/mirror/{base/install', 'rbd/singleton/{all/permissions', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/rbd_cls_tests}', 'workloads/rbd-mirror-workunit-min-compat-client-octopus}', 'workloads/rbd-mirror-workunit-policy-none}', 'workloads/rbd_cli_import_export}'] 2023-01-27T10:25:45.538 INFO:scrape: 2023-01-27T10:25:45.538 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds 2023-01-27T10:25:45.539 INFO:scrape:1 jobs: ['7139364'] 2023-01-27T10:25:45.539 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2023-01-27T10:25:45.539 INFO:scrape: 2023-01-27T10:25:45.540 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi169.front.sepia.ceph.com: ['type=AVC msg=audit(1674800912.473:15022): avc: denied { open } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15024): avc: denied { map } for pid=61344 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:421): avc: denied { map } for pid=7002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.123:14999): avc: denied { search } for pid=6912 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674800912.473:15022): avc: denied { read } for pid=61344 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { read } for pid=7002 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15023): avc: denied { lock } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:420): avc: denied { lock } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { open } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.540 INFO:scrape:8 jobs: ['7139467', '7139323', '7139482', '7139395', '7139428', '7139362', '7139344', '7139457'] 2023-01-27T10:25:45.541 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.541 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/simple', 'pool/none', 'rbd-mirror/four-per-cluster', 'rbd/cli/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/nbd/{base/install', 'rbd/singleton/{all/qemu-iotests-writethrough', 'rbd/singleton/{all/rbd-vs-unmanaged-snaps', 'rbd/singleton/{all/rbdmap_RBDMAPFILE', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'thrashers/cache', 'thrashers/default', 'thrashosds-health', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}', 'workloads/rbd_cli_luks_encryption}', 'workloads/rbd_nbd}'] 2023-01-27T10:25:45.541 INFO:scrape: 2023-01-27T10:25:45.542 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi012.front.sepia.ceph.com: ['type=AVC msg=audit(1674799756.973:19490): avc: denied { read write } for pid=79660 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15022): avc: denied { lock } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19495): avc: denied { lock } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { open } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { open } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17308): avc: denied { lock } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19491): avc: denied { lock } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19492): avc: denied { getattr } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { read } for pid=61332 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19496): avc: denied { map } for pid=79717 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19493): avc: denied { map } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19490): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { read } for pid=79717 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17309): avc: denied { map } for pid=69869 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { open } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { read } for pid=79660 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.556:17276): avc: denied { read } for pid=869 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.465:15023): avc: denied { map } for pid=61332 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.107:14990): avc: denied { search } for pid=6902 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { read } for pid=69869 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.542 INFO:scrape:1 jobs: ['7139453'] 2023-01-27T10:25:45.543 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/filestore-xfs', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff}'] 2023-01-27T10:25:45.543 INFO:scrape: 2023-01-27T10:25:45.543 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-01-27T10:25:45.544 INFO:scrape:3 jobs: ['7139461', '7139317', '7139347'] 2023-01-27T10:25:45.544 INFO:scrape:suites intersection: ['clusters/{fixed-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'workloads/rbd_cli_generic}'] 2023-01-27T10:25:45.544 INFO:scrape:suites union: ['clusters/{fixed-1', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd_cli_generic}'] 2023-01-27T10:25:45.545 INFO:scrape: 2023-01-27T10:25:45.545 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674785483.791:15034): avc: denied { map } for pid=61349 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.438:15011): avc: denied { search } for pid=6923 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674785483.791:15033): avc: denied { lock } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17391): avc: denied { map } for pid=70123 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { open } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { read } for pid=7013 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:428): avc: denied { lock } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { open } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:429): avc: denied { map } for pid=7013 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { open } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17317): avc: denied { lock } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { read } for pid=69884 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { open } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { read } for pid=70123 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17390): avc: denied { lock } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17318): avc: denied { map } for pid=69884 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.496:17285): avc: denied { read } for pid=867 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { read } for pid=61349 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.546 INFO:scrape:3 jobs: ['7139348', '7139363', '7139384'] 2023-01-27T10:25:45.546 INFO:scrape:suites intersection: [] 2023-01-27T10:25:45.546 INFO:scrape:suites union: ['cachepool/small', 'clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/singleton/{all/read-flags-writeback', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'tasks/rbd_lock_and_fence}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}'] 2023-01-27T10:25:45.547 INFO:scrape: 2023-01-27T10:25:45.547 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674789523.009:16961): avc: denied { read } for pid=692 comm="sssd" name="resolv.conf" dev="sda1" ino=525300 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { open } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { open } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16993): avc: denied { lock } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { read } for pid=94007 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.230:217): avc: denied { map } for pid=6342 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { read } for pid=77380 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16994): avc: denied { map } for pid=94007 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14038): avc: denied { lock } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { read } for pid=6342 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789398.678:14036): avc: denied { search } for pid=6229 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674789399.032:14039): avc: denied { map } for pid=77380 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { open } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.220:216): avc: denied { lock } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] 2023-01-27T10:25:45.548 INFO:scrape:3 jobs: ['7139377', '7139435', '7139336'] 2023-01-27T10:25:45.548 INFO:scrape:suites intersection: ['openstack}'] 2023-01-27T10:25:45.548 INFO:scrape:suites union: ['base/install', 'cachepool/none', 'cluster/{fixed-3', 'clusters/{fixed-1', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/ec-data-pool', 'rbd/basic/{base/install', 'rbd/cli/{base/install', 'rbd/iscsi/{0-single-container-host', 'supported-random-distro$/{centos_8}', 'tasks/rbd_cls_tests}', 'workloads/cephadm_iscsi}', 'workloads/rbd_cli_luks_encryption}'] 2023-01-27T10:25:45.549 INFO:scrape: 2023-01-27T10:25:45.549 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi093.front.sepia.ceph.com: ['type=AVC msg=audit(1674784173.063:15019): avc: denied { map } for pid=61328 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:416): avc: denied { map } for pid=6987 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { open } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { read } for pid=6987 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { open } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:415): avc: denied { lock } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { read } for pid=61328 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15018): avc: denied { lock } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784172.718:14996): avc: denied { search } for pid=6897 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] 2023-01-27T10:25:45.550 INFO:scrape:2 jobs: ['7139332', '7139466'] 2023-01-27T10:25:45.550 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}', 'supported-random-distro$/{rhel_8}'] 2023-01-27T10:25:45.550 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'pool/none', 'rbd-mirror/four-per-cluster', 'rbd/cli_v1/{base/install', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd_cli_import_export}'] 2023-01-27T10:25:45.551 INFO:scrape: 2023-01-27T10:25:45.551 INFO:scrape:Failure: Command failed on smithi175 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2023-01-27T10:25:45.552 INFO:scrape:1 jobs: ['7139446'] 2023-01-27T10:25:45.552 INFO:scrape:suites: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install'] 2023-01-27T10:25:45.552 INFO:scrape: 2023-01-27T10:25:45.553 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi142.front.sepia.ceph.com: ['type=AVC msg=audit(1674797498.366:214): avc: denied { lock } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { read } for pid=94164 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14039): avc: denied { map } for pid=77401 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17021): avc: denied { lock } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { read } for pid=6359 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { open } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { open } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.060:16989): avc: denied { read } for pid=699 comm="sssd" name="resolv.conf" dev="sda1" ino=525304 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { read } for pid=77401 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17022): avc: denied { map } for pid=94164 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { open } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14038): avc: denied { lock } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.371:215): avc: denied { map } for pid=6359 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797744.817:14034): avc: denied { search } for pid=6246 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] 2023-01-27T10:25:45.553 INFO:scrape:3 jobs: ['7139440', '7139479', '7139474'] 2023-01-27T10:25:45.554 INFO:scrape:suites intersection: ['openstack}'] 2023-01-27T10:25:45.554 INFO:scrape:suites union: ['centos_latest', 'clients/{mirror-extra', 'cluster/{2-node', 'clusters/{fixed-1', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rbd/mirror/{base/install', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'validator/memcheck', 'workloads/fsx}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-workunit-minimum}'] 2023-01-27T10:25:45.554 INFO:scrape: 2023-01-27T10:25:45.561 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/ failed: 126 dead: 0 running: 0 waiting: 0 queued: 0 passed: 56 Fail ================================================================= [7139311] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 01:03:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139311/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139311/ "2023-01-27T01:47:29.806340+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139312] rbd/singleton/{all/qos objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139312/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139312/ "2023-01-27T01:35:17.800605+0000 mon.a (mon.0) 105 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139316] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:26:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139316/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139316/ "2023-01-27T01:38:41.347752+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139317] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:19:12 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139317/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139317/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4bb87b789b134ae99469a1d934f43e47 Command failed (workunit test rbd/cli_generic.sh) on smithi121 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [7139318] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/qemu_on_immutable_object_cache_and_thrash} ----------------------------------------------------------------- time: 01:04:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139318/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139318/ "2023-01-27T01:44:57.961593+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139319] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 01:30:28 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139319/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139319/ "2023-01-27T01:46:40.898967+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139321] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139321/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139321/ "2023-01-27T01:57:33.636456+0000 mon.a (mon.0) 977 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139322] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 02:08:50 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139322/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139322/ "2023-01-27T01:49:47.328484+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139323] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139323/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139323/ SELinux denials found on ubuntu@smithi173.front.sepia.ceph.com: ['type=AVC msg=audit(1674783878.517:14040): avc: denied { map } for pid=77399 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16993): avc: denied { map } for pid=94010 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.716:212): avc: denied { lock } for pid=2548 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.722:213): avc: denied { map } for pid=2548 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783877.316:14035): avc: denied { search } for pid=1847 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674783628.708:211): avc: denied { read } for pid=2548 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14038): avc: denied { open } for pid=77399 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783999.787:16960): avc: denied { read } for pid=696 comm="sssd" name="resolv.conf" dev="sda1" ino=525261 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16992): avc: denied { lock } for pid=94010 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16991): avc: denied { read } for pid=94010 comm="rpm" name="Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16991): avc: denied { open } for pid=94010 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14039): avc: denied { lock } for pid=77399 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.708:211): avc: denied { open } for pid=2548 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14038): avc: denied { read } for pid=77399 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139325] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:45:54 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139325/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139325/ "2023-01-27T01:52:01.364259+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139326] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:22:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139326/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139326/ "2023-01-27T02:00:08.207374+0000 mon.a (mon.0) 490 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139327] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/fsx} ----------------------------------------------------------------- time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139327/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139327/ SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC msg=audit(1674783788.486:210): avc: denied { map } for pid=2391 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.479:209): avc: denied { lock } for pid=2391 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:212): avc: denied { read } for pid=3700 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:212): avc: denied { open } for pid=3700 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:213): avc: denied { lock } for pid=3700 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.465:208): avc: denied { open } for pid=2391 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:214): avc: denied { map } for pid=3700 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.465:208): avc: denied { read } for pid=2391 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139328] rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:46:17 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139328/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139328/ "2023-01-27T01:58:09.700616+0000 mon.a (mon.0) 592 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139330] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:56:59 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139330/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139330/ SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674784309.581:16985): avc: denied { lock } for pid=93971 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.024:208): avc: denied { read } for pid=2503 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16984): avc: denied { read } for pid=93971 comm="rpm" name="Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16984): avc: denied { open } for pid=93971 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16986): avc: denied { map } for pid=93971 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.064:210): avc: denied { map } for pid=2503 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.024:208): avc: denied { open } for pid=2503 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.045:209): avc: denied { lock } for pid=2503 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.221:16953): avc: denied { read } for pid=694 comm="sssd" name="resolv.conf" dev="sda1" ino=525299 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1'] [7139332] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139332/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139332/ SELinux denials found on ubuntu@smithi093.front.sepia.ceph.com: ['type=AVC msg=audit(1674784173.063:15019): avc: denied { map } for pid=61328 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:416): avc: denied { map } for pid=6987 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { open } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { read } for pid=6987 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { open } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:415): avc: denied { lock } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { read } for pid=61328 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15018): avc: denied { lock } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784172.718:14996): avc: denied { search } for pid=6897 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] [7139333] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139333/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139333/ SELinux denials found on ubuntu@smithi112.front.sepia.ceph.com: ['type=AVC msg=audit(1674784275.590:15021): avc: denied { map } for pid=61349 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15020): avc: denied { lock } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.594:21275): avc: denied { read } for pid=100598 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17304): avc: denied { lock } for pid=69882 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.483:21423): avc: denied { map } for pid=101327 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21239): avc: denied { getattr } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15019): avc: denied { open } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21247): avc: denied { lock } for pid=100755 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17305): avc: denied { map } for pid=69882 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.237:17272): avc: denied { read } for pid=873 comm="sssd" name="resolv.conf" dev="sda1" ino=394924 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17378): avc: denied { map } for pid=70121 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17303): avc: denied { open } for pid=69882 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21237): avc: denied { open } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.243:14998): avc: denied { search } for pid=6922 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674784773.483:21422): avc: denied { lock } for pid=101327 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17377): avc: denied { lock } for pid=70121 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.594:21275): avc: denied { open } for pid=100598 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21237): avc: denied { read write } for pid=100598 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21246): avc: denied { read } for pid=100755 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21248): avc: denied { map } for pid=100755 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15019): avc: denied { read } for pid=61349 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17376): avc: denied { open } for pid=70121 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17303): avc: denied { read } for pid=69882 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21246): avc: denied { open } for pid=100755 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.482:21421): avc: denied { open } for pid=101327 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21240): avc: denied { map } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.482:21421): avc: denied { read } for pid=101327 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17376): avc: denied { read } for pid=70121 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21238): avc: denied { lock } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139334] rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/8G 7-workloads/recovery} ----------------------------------------------------------------- time: 00:41:06 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139334/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139334/ "2023-01-27T01:59:47.358096+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139335] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139335/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139335/ "2023-01-27T02:00:44.499606+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139336] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_luks_encryption} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139336/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139336/ SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674784719.824:16954): avc: denied { read } for pid=688 comm="sssd" name="resolv.conf" dev="sda1" ino=525299 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.229:208): avc: denied { open } for pid=2222 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16985): avc: denied { read } for pid=93960 comm="rpm" name="Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.229:208): avc: denied { read } for pid=2222 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16986): avc: denied { lock } for pid=93960 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:214): avc: denied { map } for pid=3528 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.249:209): avc: denied { lock } for pid=2222 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16985): avc: denied { open } for pid=93960 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.254:210): avc: denied { map } for pid=2222 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16987): avc: denied { map } for pid=93960 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:213): avc: denied { lock } for pid=3528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:212): avc: denied { read } for pid=3528 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:212): avc: denied { open } for pid=3528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139337] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139337/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139337/ "2023-01-27T02:05:56.890168+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139342] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:18:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139342/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139342/ "2023-01-27T02:14:03.768854+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139344] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139344/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139344/ SELinux denials found on ubuntu@smithi182.front.sepia.ceph.com: ['type=AVC msg=audit(1674785154.254:15000): avc: denied { search } for pid=6896 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674784891.641:418): avc: denied { read } for pid=6986 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15022): avc: denied { lock } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.641:418): avc: denied { open } for pid=6986 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.642:419): avc: denied { lock } for pid=6986 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15021): avc: denied { open } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15021): avc: denied { read } for pid=61328 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.642:420): avc: denied { map } for pid=6986 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.601:15023): avc: denied { map } for pid=61328 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139346] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests} ----------------------------------------------------------------- time: 00:32:48 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139346/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139346/ "2023-01-27T02:31:58.955634+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139347] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:37:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139347/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139347/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e83c1a50bd0463c9c3c87e25aef6e53 Command failed (workunit test rbd/cli_generic.sh) on smithi098 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [7139348] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:53:56 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139348/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139348/ SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674785483.791:15034): avc: denied { map } for pid=61349 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.438:15011): avc: denied { search } for pid=6923 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674785483.791:15033): avc: denied { lock } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17391): avc: denied { map } for pid=70123 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { open } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { read } for pid=7013 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:428): avc: denied { lock } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { open } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:429): avc: denied { map } for pid=7013 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { open } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17317): avc: denied { lock } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { read } for pid=69884 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { open } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { read } for pid=70123 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17390): avc: denied { lock } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17318): avc: denied { map } for pid=69884 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.496:17285): avc: denied { read } for pid=867 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { read } for pid=61349 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139350] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} ----------------------------------------------------------------- time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139350/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139350/ "2023-01-27T02:18:35.391685+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139351] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_fio} ----------------------------------------------------------------- time: 00:32:36 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139351/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139351/ "2023-01-27T02:19:18.055961+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139352] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_migration} ----------------------------------------------------------------- time: 00:25:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139352/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139352/ "2023-01-27T02:28:18.844842+0000 mon.a (mon.0) 156 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139353] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 01:25:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139353/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139353/ "2023-01-27T02:24:59.950616+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139354] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 01:04:36 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139354/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139354/ "2023-01-27T02:30:08.006406+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139356] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 01:08:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139356/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139356/ "2023-01-27T02:33:22.324986+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139357] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 01:37:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139357/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139357/ "2023-01-27T02:32:15.141551+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139358] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:26:11 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139358/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139358/ SELinux denials found on ubuntu@smithi165.front.sepia.ceph.com: ['type=AVC msg=audit(1674786749.098:15025): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786748.752:15002): avc: denied { search } for pid=6922 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674786749.098:15024): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139360] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:41:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139360/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139360/ "2023-01-27T02:43:46.283239+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139362] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139362/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139362/ SELinux denials found on ubuntu@smithi016.front.sepia.ceph.com: ['type=AVC msg=audit(1674787273.495:14039): avc: denied { read } for pid=77369 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16994): avc: denied { map } for pid=93980 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16992): avc: denied { read } for pid=93980 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14039): avc: denied { open } for pid=77369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.944:214): avc: denied { lock } for pid=6317 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.952:215): avc: denied { map } for pid=6317 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787272.346:14036): avc: denied { search } for pid=6204 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787396.255:16961): avc: denied { read } for pid=689 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16992): avc: denied { open } for pid=93980 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16993): avc: denied { lock } for pid=93980 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.934:213): avc: denied { read } for pid=6317 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14040): avc: denied { lock } for pid=77369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.934:213): avc: denied { open } for pid=6317 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14041): avc: denied { map } for pid=77369 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139363] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139363/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139363/ SELinux denials found on ubuntu@smithi161.front.sepia.ceph.com: ['type=AVC msg=audit(1674787291.097:14038): avc: denied { lock } for pid=77400 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14044): avc: denied { lock } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787290.737:14036): avc: denied { search } for pid=6247 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525252 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787044.648:213): avc: denied { open } for pid=6360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14043): avc: denied { read } for pid=77407 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14043): avc: denied { open } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.657:214): avc: denied { lock } for pid=6360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16997): avc: denied { map } for pid=94017 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.096:14037): avc: denied { open } for pid=77400 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16996): avc: denied { lock } for pid=94017 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16995): avc: denied { open } for pid=94017 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14045): avc: denied { map } for pid=77407 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.758:16998): avc: denied { read } for pid=740 comm="sssd" name="resolv.conf" dev="sda1" ino=395820 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.668:215): avc: denied { map } for pid=6360 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.097:14039): avc: denied { map } for pid=77400 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.648:213): avc: denied { read } for pid=6360 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.096:14037): avc: denied { read } for pid=77400 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.385:16964): avc: denied { read } for pid=740 comm="sssd" name="resolv.conf" dev="sda1" ino=395818 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16995): avc: denied { read } for pid=94017 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139364] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:56:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139364/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139364/ reached maximum tries (50) after waiting for 300 seconds [7139365] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:13:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139365/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139365/ SELinux denials found on ubuntu@smithi080.front.sepia.ceph.com: ['type=AVC msg=audit(1674787117.189:15024): avc: denied { map } for pid=61363 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:421): avc: denied { map } for pid=7021 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:420): avc: denied { lock } for pid=7021 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15022): avc: denied { read } for pid=61363 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15023): avc: denied { lock } for pid=61363 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15022): avc: denied { open } for pid=61363 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787116.838:15001): avc: denied { search } for pid=6931 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674786853.717:419): avc: denied { read } for pid=7021 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:419): avc: denied { open } for pid=7021 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139366] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:33:59 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139366/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139366/ "2023-01-27T03:05:42.276740+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139369] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:34:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139369/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139369/ "2023-01-27T03:04:14.388930+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139370] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 01:48:57 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139370/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139370/ "2023-01-27T03:01:49.673925+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139371] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} ----------------------------------------------------------------- time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139371/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139371/ SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674787790.129:418): avc: denied { read } for pid=6997 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15023): avc: denied { read } for pid=61340 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15023): avc: denied { open } for pid=61340 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787790.129:420): avc: denied { map } for pid=6997 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787790.129:418): avc: denied { open } for pid=6997 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15025): avc: denied { map } for pid=61340 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.022:15000): avc: denied { search } for pid=6907 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787790.129:419): avc: denied { lock } for pid=6997 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15024): avc: denied { lock } for pid=61340 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139373] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} ----------------------------------------------------------------- time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139373/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139373/ "2023-01-27T03:04:40.688909+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139375] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:25:23 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139375/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139375/ "2023-01-27T03:16:37.233199+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139376] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:29:10 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139376/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139376/ "2023-01-27T03:07:32.595411+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139377] rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:38:28 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139377/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139377/ SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674789523.009:16961): avc: denied { read } for pid=692 comm="sssd" name="resolv.conf" dev="sda1" ino=525300 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { open } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { open } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16993): avc: denied { lock } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { read } for pid=94007 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.230:217): avc: denied { map } for pid=6342 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { read } for pid=77380 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16994): avc: denied { map } for pid=94007 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14038): avc: denied { lock } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { read } for pid=6342 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789398.678:14036): avc: denied { search } for pid=6229 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674789399.032:14039): avc: denied { map } for pid=77380 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { open } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.220:216): avc: denied { lock } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139379] rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:47:23 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139379/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139379/ "2023-01-27T03:23:02.157277+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139380] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:20:26 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139380/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139380/ "2023-01-27T03:35:51.553631+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139384] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139384/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139384/ SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1674790541.377:16961): avc: denied { read } for pid=687 comm="sssd" name="resolv.conf" dev="sda1" ino=525293 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.345:212): avc: denied { read } for pid=6337 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790414.641:14036): avc: denied { search } for pid=6055 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393279 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674790541.753:16992): avc: denied { read } for pid=94002 comm="rpm" name="Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.376:214): avc: denied { map } for pid=6337 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14038): avc: denied { lock } for pid=77381 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14039): avc: denied { map } for pid=77381 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16993): avc: denied { lock } for pid=94002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16994): avc: denied { map } for pid=94002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.345:212): avc: denied { open } for pid=6337 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14037): avc: denied { read } for pid=77381 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14037): avc: denied { open } for pid=77381 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.367:213): avc: denied { lock } for pid=6337 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16992): avc: denied { open } for pid=94002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139385] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:33:22 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139385/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139385/ "2023-01-27T03:56:58.726269+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139386] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 02:03:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139386/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139386/ "2023-01-27T03:41:57.711538+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139388] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} ----------------------------------------------------------------- time: 00:17:14 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139388/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139388/ "2023-01-27T03:43:38.104429+0000 mgr.y (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139389] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139389/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139389/ "2023-01-27T03:48:26.138137+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139393] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 03:18:56 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139393/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139393/ "2023-01-27T03:54:19.051412+0000 mgr.y (mgr.4129) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139394] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139394/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139394/ SELinux denials found on ubuntu@smithi203.front.sepia.ceph.com: ['type=AVC msg=audit(1674790889.602:418): avc: denied { map } for pid=7013 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15020): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15019): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.634:14998): avc: denied { search } for pid=6923 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674790889.602:416): avc: denied { open } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15021): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790889.602:416): avc: denied { read } for pid=7013 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15019): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790889.602:417): avc: denied { lock } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139395] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139395/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139395/ SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674791466.599:15034): avc: denied { open } for pid=61374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17353): avc: denied { lock } for pid=70016 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.599:15036): avc: denied { map } for pid=61374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17352): avc: denied { read } for pid=70016 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.245:15013): avc: denied { search } for pid=6941 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674791466.599:15034): avc: denied { read } for pid=61374 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17354): avc: denied { map } for pid=70016 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17352): avc: denied { open } for pid=70016 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.599:15035): avc: denied { lock } for pid=61374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791562.754:17317): avc: denied { read } for pid=788 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1'] [7139396] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 01:39:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139396/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139396/ "2023-01-27T04:04:14.228054+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139399] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:45:03 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139399/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139399/ "2023-01-27T04:09:50.108780+0000 mon.a (mon.0) 226 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [7139401] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} ----------------------------------------------------------------- time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139401/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139401/ "2023-01-27T04:10:41.134436+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139402] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139402/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139402/ "2023-01-27T04:14:45.254355+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139403] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} ----------------------------------------------------------------- time: 00:54:54 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139403/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139403/ "2023-01-27T04:29:19.135325+0000 mon.a (mon.0) 756 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139407] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139407/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139407/ SELinux denials found on ubuntu@smithi019.front.sepia.ceph.com: ['type=AVC msg=audit(1674792611.189:14038): avc: denied { lock } for pid=77348 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14037): avc: denied { open } for pid=77348 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14037): avc: denied { read } for pid=77348 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14039): avc: denied { map } for pid=77348 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.737:212): avc: denied { lock } for pid=6193 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16992): avc: denied { open } for pid=93966 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16992): avc: denied { read } for pid=93966 comm="rpm" name="Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16994): avc: denied { map } for pid=93966 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525263 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.716:211): avc: denied { open } for pid=6193 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17065): avc: denied { map } for pid=94283 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525263 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.052:16961): avc: denied { read } for pid=680 comm="sssd" name="resolv.conf" dev="sda1" ino=525295 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17063): avc: denied { open } for pid=94283 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17064): avc: denied { lock } for pid=94283 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16993): avc: denied { lock } for pid=93966 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.747:213): avc: denied { map } for pid=6193 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.448:16995): avc: denied { read } for pid=680 comm="sssd" name="resolv.conf" dev="sda1" ino=525297 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.716:211): avc: denied { read } for pid=6193 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792610.772:14036): avc: denied { search } for pid=5378 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393279 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674792739.238:17063): avc: denied { read } for pid=94283 comm="rpm" name="Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139409] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:24:34 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139409/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139409/ "2023-01-27T04:25:55.734004+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139411] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 02:34:43 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139411/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139411/ "2023-01-27T04:30:49.950760+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139412] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} ----------------------------------------------------------------- time: 00:33:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139412/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139412/ "2023-01-27T04:25:55.671056+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139413] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 02:06:26 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139413/ "2023-01-27T04:31:38.903130+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139414] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} ----------------------------------------------------------------- time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139414/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139414/ SELinux denials found on ubuntu@smithi077.front.sepia.ceph.com: ['type=AVC msg=audit(1674793419.933:210): avc: denied { lock } for pid=2519 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.921:209): avc: denied { open } for pid=2519 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:213): avc: denied { open } for pid=3718 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:213): avc: denied { read } for pid=3718 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.921:209): avc: denied { read } for pid=2519 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.944:211): avc: denied { map } for pid=2519 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:215): avc: denied { map } for pid=3718 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:214): avc: denied { lock } for pid=3718 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139415] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 01:01:19 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139415/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139415/ SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC msg=audit(1674793300.769:420): avc: denied { lock } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15024): avc: denied { map } for pid=61343 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793571.666:14989): avc: denied { search } for pid=6912 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674793572.015:15022): avc: denied { open } for pid=61343 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:419): avc: denied { read } for pid=7002 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:419): avc: denied { open } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15023): avc: denied { lock } for pid=61343 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:421): avc: denied { map } for pid=7002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15022): avc: denied { read } for pid=61343 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139418] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:22:25 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139418/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139418/ "2023-01-27T04:43:23.758098+0000 mon.a (mon.0) 516 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139419] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests} ----------------------------------------------------------------- time: 00:46:29 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139419/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139419/ "2023-01-27T04:53:47.302450+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139420] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} ----------------------------------------------------------------- time: 00:34:23 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139420/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139420/ "2023-01-27T04:41:12.912650+0000 mgr.y (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139421] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:12:09 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139421/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139421/ SELinux denials found on ubuntu@smithi169.front.sepia.ceph.com: ['type=AVC msg=audit(1674793934.746:210): avc: denied { read } for pid=3370 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14037): avc: denied { open } for pid=77371 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794179.127:14034): avc: denied { search } for pid=1873 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674794180.423:14039): avc: denied { map } for pid=77371 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14037): avc: denied { read } for pid=77371 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14038): avc: denied { lock } for pid=77371 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.764:211): avc: denied { lock } for pid=3370 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.766:212): avc: denied { map } for pid=3370 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.746:210): avc: denied { open } for pid=3370 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139422] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139422/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139422/ SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674794432.272:14038): avc: denied { open } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.273:14040): avc: denied { map } for pid=77374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794431.909:14035): avc: denied { search } for pid=1821 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674794432.273:14039): avc: denied { lock } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.272:14038): avc: denied { read } for pid=77374 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139426] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 01:31:13 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139426/ "2023-01-27T05:02:55.135528+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139428] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} ----------------------------------------------------------------- time: 00:13:10 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139428/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139428/ SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1674795418.423:15023): avc: denied { lock } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:419): avc: denied { open } for pid=6991 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15022): avc: denied { open } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15024): avc: denied { map } for pid=61332 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17306): avc: denied { open } for pid=69858 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.067:14999): avc: denied { search } for pid=6900 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674795145.682:421): avc: denied { map } for pid=6991 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17307): avc: denied { lock } for pid=69858 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:419): avc: denied { read } for pid=6991 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17306): avc: denied { read } for pid=69858 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15022): avc: denied { read } for pid=61332 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795518.648:17275): avc: denied { read } for pid=866 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:420): avc: denied { lock } for pid=6991 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17308): avc: denied { map } for pid=69858 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139429] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139429/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139429/ "2023-01-27T05:08:46.180806+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139430] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 01:06:49 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139430/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139430/ "2023-01-27T05:08:06.704087+0000 mgr.x (mgr.4122) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139431] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:36:02 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139431/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139431/ SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674795677.080:15036): avc: denied { map } for pid=61358 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.636:19711): avc: denied { read } for pid=87559 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:420): avc: denied { lock } for pid=6994 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17320): avc: denied { map } for pid=69894 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19510): avc: denied { map } for pid=86742 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795772.934:17287): avc: denied { read } for pid=902 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19508): avc: denied { open } for pid=86742 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797222.301:19507): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797545.636:19713): avc: denied { map } for pid=87559 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:419): avc: denied { open } for pid=6994 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19509): avc: denied { lock } for pid=86742 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19508): avc: denied { read } for pid=86742 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17318): avc: denied { open } for pid=69894 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.253:19678): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797545.636:19711): avc: denied { open } for pid=87559 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.636:19712): avc: denied { lock } for pid=87559 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:419): avc: denied { read } for pid=6994 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15034): avc: denied { open } for pid=61358 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15035): avc: denied { lock } for pid=61358 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:421): avc: denied { map } for pid=6994 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15034): avc: denied { read } for pid=61358 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17319): avc: denied { lock } for pid=69894 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795676.717:14999): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674795773.290:17318): avc: denied { read } for pid=69894 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139432] rbd/singleton/{all/permissions objectstore/bluestore-comp-zlib openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:29 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139432/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139432/ SELinux denials found on ubuntu@smithi090.front.sepia.ceph.com: ['type=AVC msg=audit(1674795841.947:415): avc: denied { map } for pid=7026 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.301:14995): avc: denied { search } for pid=6936 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674796103.646:15017): avc: denied { lock } for pid=61369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15018): avc: denied { map } for pid=61369 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15016): avc: denied { read } for pid=61369 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:414): avc: denied { lock } for pid=7026 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:413): avc: denied { read } for pid=7026 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:413): avc: denied { open } for pid=7026 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15016): avc: denied { open } for pid=61369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139433] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:59:13 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139433/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139433/ "2023-01-27T05:22:13.822531+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139435] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139435/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139435/ SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1674796515.146:214): avc: denied { lock } for pid=6351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.136:213): avc: denied { read } for pid=6351 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796893.682:16961): avc: denied { read } for pid=715 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14035): avc: denied { open } for pid=77387 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17056): avc: denied { read } for pid=94315 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17057): avc: denied { lock } for pid=94315 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.136:213): avc: denied { open } for pid=6351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17056): avc: denied { open } for pid=94315 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16992): avc: denied { open } for pid=94006 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16994): avc: denied { map } for pid=94006 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17058): avc: denied { map } for pid=94315 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.150:215): avc: denied { map } for pid=6351 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14036): avc: denied { lock } for pid=77387 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.520:14034): avc: denied { search } for pid=6238 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674796894.040:16992): avc: denied { read } for pid=94006 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14035): avc: denied { read } for pid=77387 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16993): avc: denied { lock } for pid=94006 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14037): avc: denied { map } for pid=77387 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139436] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:46:19 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139436/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139436/ "2023-01-27T05:45:27.076788+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139438] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} ----------------------------------------------------------------- time: 00:27:17 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139438/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139438/ "2023-01-27T05:29:42.409472+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139439] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 02:12:35 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139439/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139439/ "2023-01-27T05:37:05.017852+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139440] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139440/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139440/ SELinux denials found on ubuntu@smithi142.front.sepia.ceph.com: ['type=AVC msg=audit(1674797498.366:214): avc: denied { lock } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { read } for pid=94164 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14039): avc: denied { map } for pid=77401 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17021): avc: denied { lock } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { read } for pid=6359 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { open } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { open } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.060:16989): avc: denied { read } for pid=699 comm="sssd" name="resolv.conf" dev="sda1" ino=525304 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { read } for pid=77401 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17022): avc: denied { map } for pid=94164 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { open } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14038): avc: denied { lock } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.371:215): avc: denied { map } for pid=6359 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797744.817:14034): avc: denied { search } for pid=6246 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] [7139442] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139442/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139442/ SELinux denials found on ubuntu@smithi090.front.sepia.ceph.com: ['type=AVC msg=audit(1674797849.155:14038): avc: denied { lock } for pid=77415 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.824:214): avc: denied { lock } for pid=6373 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797849.155:14039): avc: denied { map } for pid=77415 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.794:213): avc: denied { read } for pid=6373 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.794:213): avc: denied { open } for pid=6373 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.824:215): avc: denied { map } for pid=6373 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797847.688:14034): avc: denied { search } for pid=6260 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797849.155:14037): avc: denied { read } for pid=77415 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797849.155:14037): avc: denied { open } for pid=77415 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139444] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} ----------------------------------------------------------------- time: 00:32:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139444/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139444/ "2023-01-27T05:56:35.881621+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139445] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139445/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139445/ "2023-01-27T05:51:29.611184+0000 mgr.x (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139446] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:59:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139446/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139446/ Command failed on smithi175 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [7139447] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 01:13:38 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139447/ "2023-01-27T05:55:21.374003+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139448] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} ----------------------------------------------------------------- time: 00:31:34 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139448/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139448/ "2023-01-27T05:53:09.562455+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139449] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:54:23 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139449/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139449/ SELinux denials found on ubuntu@smithi101.front.sepia.ceph.com: ['type=AVC msg=audit(1674798745.427:15034): avc: denied { read } for pid=61368 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19741): avc: denied { read } for pid=89897 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19518): avc: denied { map } for pid=89014 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19516): avc: denied { open } for pid=89014 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19516): avc: denied { read } for pid=89014 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798745.427:15034): avc: denied { open } for pid=61368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.029:19707): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674798745.427:15036): avc: denied { map } for pid=61368 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:421): avc: denied { map } for pid=7015 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19741): avc: denied { open } for pid=89897 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:419): avc: denied { read } for pid=7015 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:419): avc: denied { open } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:420): avc: denied { lock } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801182.342:19515): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674798745.427:15035): avc: denied { lock } for pid=61368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19743): avc: denied { map } for pid=89897 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19517): avc: denied { lock } for pid=89014 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19742): avc: denied { lock } for pid=89897 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798745.083:15013): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] [7139452] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:32:15 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139452/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139452/ "2023-01-27T06:08:18.931774+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139453] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} ----------------------------------------------------------------- time: 00:25:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139453/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139453/ SELinux denials found on ubuntu@smithi012.front.sepia.ceph.com: ['type=AVC msg=audit(1674799756.973:19490): avc: denied { read write } for pid=79660 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15022): avc: denied { lock } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19495): avc: denied { lock } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { open } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { open } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17308): avc: denied { lock } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19491): avc: denied { lock } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19492): avc: denied { getattr } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { read } for pid=61332 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19496): avc: denied { map } for pid=79717 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19493): avc: denied { map } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19490): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { read } for pid=79717 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17309): avc: denied { map } for pid=69869 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { open } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { read } for pid=79660 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.556:17276): avc: denied { read } for pid=869 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.465:15023): avc: denied { map } for pid=61332 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.107:14990): avc: denied { search } for pid=6902 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { read } for pid=69869 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139454] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139454/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139454/ SELinux denials found on ubuntu@smithi156.front.sepia.ceph.com: ['type=AVC msg=audit(1674799376.292:17304): avc: denied { lock } for pid=69876 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.535:14996): avc: denied { search } for pid=6903 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799377.076:17380): avc: denied { read } for pid=70140 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17380): avc: denied { open } for pid=70140 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:415): avc: denied { lock } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15019): avc: denied { read } for pid=61350 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15019): avc: denied { open } for pid=61350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.291:17303): avc: denied { open } for pid=69876 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17381): avc: denied { lock } for pid=70140 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:416): avc: denied { map } for pid=6993 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:414): avc: denied { open } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.292:17305): avc: denied { map } for pid=69876 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17382): avc: denied { map } for pid=70140 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:414): avc: denied { read } for pid=6993 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15020): avc: denied { lock } for pid=61350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799375.942:17272): avc: denied { read } for pid=892 comm="sssd" name="resolv.conf" dev="sda1" ino=394924 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.291:17303): avc: denied { read } for pid=69876 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15021): avc: denied { map } for pid=61350 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139455] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 01:01:09 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139455/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139455/ "2023-01-27T06:26:56.355329+0000 mon.a (mon.0) 452 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139456] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139456/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139456/ SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674799269.564:15026): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.219:15001): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15025): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.940:19432): avc: denied { map } for pid=87059 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19431): avc: denied { lock } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799779.815:19618): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19668): avc: denied { lock } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { read } for pid=87059 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { read } for pid=6999 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { open } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:420): avc: denied { lock } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:421): avc: denied { map } for pid=6999 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { open } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19669): avc: denied { map } for pid=90420 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799681.565:19429): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { read } for pid=90420 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { open } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139457] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139457/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139457/ SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674799664.827:15006): avc: denied { map } for pid=61296 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15004): avc: denied { open } for pid=61296 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15005): avc: denied { lock } for pid=61296 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.458:14971): avc: denied { search } for pid=6925 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799763.670:17305): avc: denied { read } for pid=889 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17337): avc: denied { lock } for pid=70001 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15004): avc: denied { read } for pid=61296 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17338): avc: denied { map } for pid=70001 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17336): avc: denied { read } for pid=70001 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17336): avc: denied { open } for pid=70001 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139458] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139458/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139458/ SELinux denials found on ubuntu@smithi107.front.sepia.ceph.com: ['type=AVC msg=audit(1674799829.800:14059): avc: denied { read } for pid=77509 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14060): avc: denied { lock } for pid=77509 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.665:213): avc: denied { open } for pid=6390 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17059): avc: denied { open } for pid=94350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799827.969:14036): avc: denied { search } for pid=6277 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799951.535:16995): avc: denied { open } for pid=94044 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14039): avc: denied { read } for pid=77434 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14040): avc: denied { lock } for pid=77434 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17059): avc: denied { read } for pid=94350 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.665:213): avc: denied { read } for pid=6390 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16997): avc: denied { map } for pid=94044 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14059): avc: denied { open } for pid=77509 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.671:214): avc: denied { lock } for pid=6390 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.185:16964): avc: denied { read } for pid=752 comm="sssd" name="resolv.conf" dev="sda1" ino=525300 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17060): avc: denied { lock } for pid=94350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14061): avc: denied { map } for pid=77509 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.674:215): avc: denied { map } for pid=6390 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16996): avc: denied { lock } for pid=94044 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17061): avc: denied { map } for pid=94350 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14041): avc: denied { map } for pid=77434 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16995): avc: denied { read } for pid=94044 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14039): avc: denied { open } for pid=77434 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139459] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:22:39 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139459/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139459/ "2023-01-27T06:17:22.140980+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139460] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} ----------------------------------------------------------------- time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139460/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139460/ "2023-01-27T06:16:05.008739+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139461] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:30:09 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139461/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139461/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a776d2c19024fdc83c94f43def07160 Command failed (workunit test rbd/cli_generic.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [7139462] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 01:23:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139462/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139462/ "2023-01-27T06:17:14.684494+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139463] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 01:40:56 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139463/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139463/ "2023-01-27T06:20:38.483627+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139464] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 01:39:45 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139464/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139464/ "2023-01-27T06:29:38.309223+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139466] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:51:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139466/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139466/ SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1674800612.349:15024): avc: denied { open } for pid=61351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15026): avc: denied { map } for pid=61351 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.345:17277): avc: denied { read } for pid=890 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17308): avc: denied { read } for pid=69878 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15025): avc: denied { lock } for pid=61351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17310): avc: denied { map } for pid=69878 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15024): avc: denied { read } for pid=61351 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17308): avc: denied { open } for pid=69878 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800611.994:15003): avc: denied { search } for pid=6918 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674800708.701:17309): avc: denied { lock } for pid=69878 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139467] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139467/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139467/ SELinux denials found on ubuntu@smithi169.front.sepia.ceph.com: ['type=AVC msg=audit(1674800912.473:15022): avc: denied { open } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15024): avc: denied { map } for pid=61344 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:421): avc: denied { map } for pid=7002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.123:14999): avc: denied { search } for pid=6912 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674800912.473:15022): avc: denied { read } for pid=61344 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { read } for pid=7002 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15023): avc: denied { lock } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:420): avc: denied { lock } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { open } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139468] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:25:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139468/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139468/ "2023-01-27T06:43:41.118109+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139470] rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/recovery} ----------------------------------------------------------------- time: 00:41:16 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139470/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139470/ "2023-01-27T06:38:19.106218+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139471] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139471/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139471/ "2023-01-27T06:43:26.730070+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139472] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:24:43 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139472/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139472/ "2023-01-27T06:44:58.268789+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139474] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/fsx} ----------------------------------------------------------------- time: 00:20:40 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139474/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139474/ SELinux denials found on ubuntu@smithi142.front.sepia.ceph.com: ['type=AVC msg=audit(1674801937.182:16995): avc: denied { read } for pid=94041 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.965:14064): avc: denied { lock } for pid=77528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801816.097:14036): avc: denied { search } for pid=6271 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525252 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674801573.393:215): avc: denied { map } for pid=6384 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16995): avc: denied { open } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801936.830:16964): avc: denied { read } for pid=720 comm="sssd" name="resolv.conf" dev="sda1" ino=395818 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.964:14063): avc: denied { read } for pid=77528 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16997): avc: denied { map } for pid=94041 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16996): avc: denied { lock } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.964:14063): avc: denied { open } for pid=77528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14041): avc: denied { map } for pid=77431 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.362:213): avc: denied { read } for pid=6384 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14039): avc: denied { open } for pid=77431 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14040): avc: denied { lock } for pid=77431 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.386:214): avc: denied { lock } for pid=6384 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14039): avc: denied { read } for pid=77431 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.362:213): avc: denied { open } for pid=6384 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.965:14065): avc: denied { map } for pid=77528 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139475] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} ----------------------------------------------------------------- time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139475/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139475/ "2023-01-27T06:51:56.186028+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139476] rbd/singleton/{all/qos objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:29:53 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139476/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139476/ "2023-01-27T07:03:09.453712+0000 mon.a (mon.0) 94 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139478] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 02:12:45 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139478/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139478/ "2023-01-27T07:00:29.908284+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139479] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} ----------------------------------------------------------------- time: 00:24:26 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139479/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139479/ SELinux denials found on ubuntu@smithi156.front.sepia.ceph.com: ['type=AVC msg=audit(1674802705.448:14059): avc: denied { map } for pid=77491 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14039): avc: denied { map } for pid=77416 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.733:215): avc: denied { map } for pid=6374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.727:214): avc: denied { lock } for pid=6374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14037): avc: denied { open } for pid=77416 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16995): avc: denied { read } for pid=94032 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.057:16964): avc: denied { read } for pid=703 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16997): avc: denied { map } for pid=94032 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16995): avc: denied { open } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.701:213): avc: denied { read } for pid=6374 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16996): avc: denied { lock } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802703.402:14034): avc: denied { search } for pid=6261 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674802705.448:14058): avc: denied { lock } for pid=77491 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.701:213): avc: denied { open } for pid=6374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14038): avc: denied { lock } for pid=77416 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802705.448:14057): avc: denied { open } for pid=77491 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14037): avc: denied { read } for pid=77416 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802705.448:14057): avc: denied { read } for pid=77491 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139481] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:30:42 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139481/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139481/ "2023-01-27T07:07:16.582975+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139482] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:55:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139482/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139482/ SELinux denials found on ubuntu@smithi012.front.sepia.ceph.com: ['type=AVC msg=audit(1674805803.738:19790): avc: denied { read } for pid=81126 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805803.738:19791): avc: denied { lock } for pid=81126 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805803.738:19790): avc: denied { open } for pid=81126 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15013): avc: denied { read } for pid=61309 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15015): avc: denied { map } for pid=61309 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15013): avc: denied { open } for pid=61309 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802749.715:14982): avc: denied { search } for pid=6938 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674805803.738:19792): avc: denied { map } for pid=81126 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15014): avc: denied { lock } for pid=61309 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805802.002:19785): avc: denied { search } for pid=6938 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] [7139483] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 03:27:22 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139483/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139483/ "2023-01-27T07:08:21.523379+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139485] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139485/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139485/ SELinux denials found on ubuntu@smithi080.front.sepia.ceph.com: ['type=AVC msg=audit(1674803102.553:17339): avc: denied { map } for pid=69995 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.477:15002): avc: denied { search } for pid=6913 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674803007.823:15023): avc: denied { read } for pid=61360 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:418): avc: denied { read } for pid=7003 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17337): avc: denied { open } for pid=69995 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:418): avc: denied { open } for pid=7003 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.195:17306): avc: denied { read } for pid=877 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15025): avc: denied { map } for pid=61360 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15023): avc: denied { open } for pid=61360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17337): avc: denied { read } for pid=69995 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15024): avc: denied { lock } for pid=61360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17338): avc: denied { lock } for pid=69995 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:419): avc: denied { lock } for pid=7003 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:420): avc: denied { map } for pid=7003 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1'] [7139487] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} ----------------------------------------------------------------- time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139487/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139487/ "2023-01-27T07:15:49.837208+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139488] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 01:43:53 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139488/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139488/ "2023-01-27T07:16:49.039201+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139489] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139489/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139489/ "2023-01-27T07:25:23.620975+0000 mon.a (mon.0) 517 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log [7139490] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests} ----------------------------------------------------------------- time: 00:32:48 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139490/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139490/ "2023-01-27T07:28:19.909247+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139491] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:59:58 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139491/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139491/ "2023-01-27T07:20:37.809194+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log [7139492] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:44:48 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139492/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139492/ "2023-01-27T07:29:36.773987+0000 mon.a (mon.0) 677 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log Pass ================================================================= [7139313] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 00:59:46 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139313/ [7139314] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139314/ [7139315] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139315/ [7139320] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139320/ [7139324] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:12:01 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139324/ [7139329] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 02:28:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139329/ [7139331] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:31:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139331/ [7139338] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139338/ [7139339] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 03:49:10 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139339/ [7139340] rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139340/ [7139341] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} time: 03:38:44 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139341/ [7139343] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:23:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139343/ [7139345] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} time: 00:20:51 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139345/ [7139349] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:17:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139349/ [7139355] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139355/ [7139359] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} time: 00:16:15 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139359/ [7139361] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139361/ [7139367] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} time: 00:26:37 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139367/ [7139368] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:26:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139368/ [7139372] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:33 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139372/ [7139374] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 02:10:42 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139374/ [7139378] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139378/ [7139381] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:08:08 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139381/ [7139382] rbd/singleton/{all/snap-diff objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139382/ [7139383] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:52:02 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139383/ [7139387] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:23:27 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139387/ [7139390] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139390/ [7139391] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139391/ [7139392] rbd/singleton/{all/verify_pool objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139392/ [7139397] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:02:02 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139397/ [7139398] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:16:54 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139398/ [7139400] rbd/singleton/{all/admin_socket objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:04 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139400/ [7139404] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} time: 01:20:49 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139404/ [7139405] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} time: 00:39:52 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139405/ [7139406] rbd/singleton/{all/formatted-output objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139406/ [7139408] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 02:49:47 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139408/ [7139410] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:59 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139410/ [7139416] rbd/singleton/{all/merge_diff objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:11:34 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139416/ [7139417] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:04:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139417/ [7139423] rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/fio} time: 02:45:07 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139423/ [7139424] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} time: 00:25:20 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139424/ [7139425] rbd/singleton/{all/mon-command-help objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139425/ [7139427] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139427/ [7139434] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} time: 00:37:35 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139434/ [7139437] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139437/ [7139441] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139441/ [7139443] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} time: 00:20:05 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139443/ [7139450] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139450/ [7139451] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 02:12:21 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139451/ [7139465] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139465/ [7139469] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139469/ [7139473] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} time: 00:19:17 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139473/ [7139477] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139477/ [7139480] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139480/ [7139484] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139484/ [7139486] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:10:36 info: http://pulpito.ceph.com/yuriw-2023-01-27_00:52:06-rbd-quincy-distro-default-smithi/7139486/