2023-10-22T01:37:59.305 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-22T01:37:59.308 INFO:teuthology.results:seed: '3370' 2023-10-22T02:08:07.788 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-22T02:08:07.810 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-22T08:22:34.983 INFO:teuthology.results:Tests finished! gathering results... 2023-10-22T08:22:35.569 INFO:scrape:Found 6 jobs 2023-10-22T08:22:35.579 INFO:scrape:Found 2 distinct failure reasons 2023-10-22T08:22:35.579 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2023-10-22T08:22:35.580 INFO:scrape:1 jobs: ['7434810'] 2023-10-22T08:22:35.580 INFO:scrape:suites: ['1-ceph-install/quincy', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/filestore-xfs', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack'] 2023-10-22T08:22:35.581 INFO:scrape: 2023-10-22T08:22:35.581 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi105.front.sepia.ceph.com: ['type=AVC msg=audit(1697942781.264:20320): avc: denied { rmdir } for pid=121685 comm="userdel" name="cephadm" dev="sda1" ino=656026 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=system_u:object_r:var_lib_t:s0 tclass=dir permissive=1'] 2023-10-22T08:22:35.581 INFO:scrape:1 jobs: ['7434805'] 2023-10-22T08:22:35.582 INFO:scrape:suites: ['supported-all-distro/centos_8}', 'upgrade:quincy-p2p/quincy-p2p-parallel/{point-to-point-upgrade'] 2023-10-22T08:22:35.582 INFO:scrape: 2023-10-22T08:22:35.583 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [7434805] upgrade:quincy-p2p/quincy-p2p-parallel/{point-to-point-upgrade supported-all-distro/centos_8} ----------------------------------------------------------------- time: 01:36:09 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434805/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434805/ SELinux denials found on ubuntu@smithi105.front.sepia.ceph.com: ['type=AVC msg=audit(1697942781.264:20320): avc: denied { rmdir } for pid=121685 comm="userdel" name="cephadm" dev="sda1" ino=656026 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=system_u:object_r:var_lib_t:s0 tclass=dir permissive=1'] [7434810] upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 01:39:54 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434810/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60611a498c3d4b908132a97022375327 Command failed on smithi060 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' Pass ================================================================= [7434806] upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} time: 06:28:45 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434806/ [7434807] upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health} time: 05:09:19 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434807/ [7434808] upgrade:quincy-p2p/quincy-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} time: 01:09:27 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434808/ [7434809] upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} time: 06:11:02 info: http://pulpito.ceph.com/teuthology-2023-10-22_01:35:10-upgrade:quincy-p2p-quincy-distro-default-smithi/7434809/