2024-03-25T04:53:39.155 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-25T04:53:39.156 INFO:teuthology.results:seed: '4628' 2024-03-25T05:02:00.945 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-25T05:02:00.948 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-03-25T07:10:11.209 INFO:teuthology.results:Tests finished! gathering results... 2024-03-25T07:10:12.569 INFO:scrape:Found 25 jobs 2024-03-25T07:10:14.095 INFO:scrape:Found 1 distinct failure reasons 2024-03-25T07:10:14.096 INFO:scrape:Failure: Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-25T07:10:14.096 INFO:scrape:4 jobs: ['7621153', '7621144', '7621142', '7621138'] 2024-03-25T07:10:14.096 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'cephfs-mirror/one-per-cluster', 'clients/{mirror}', 'cluster/{1-node}', 'fs:mirror/{begin/{0-install', 'mount/fuse', 'objectstore/bluestore-bitmap', 'overrides/{ignorelist_health}', 'supported-random-distros$/{centos_latest}', 'tasks/mirror}'] 2024-03-25T07:10:14.096 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'cephfs-mirror/one-per-cluster', 'clients/{mirror}', 'cluster/{1-node}', 'fs:mirror/{begin/{0-install', 'mount/fuse', 'objectstore/bluestore-bitmap', 'overrides/{ignorelist_health}', 'supported-random-distros$/{centos_latest}', 'tasks/mirror}'] 2024-03-25T07:10:14.096 INFO:scrape: 2024-03-25T07:10:14.098 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 21 Fail ================================================================= [7621138] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:26:16 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621138/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621138/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a67bbfc1fbb748c39ef087b559cec4ad Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) [7621142] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:21:07 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621142/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a28be7326f340a5aedcc715ec53fbcf Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) [7621144] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:20:39 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621144/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6e2ab8c2a6d4029aa73ed42d98aa5d8 Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) [7621153] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:20:37 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621153/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6d60b2b0c3f460aa302db331fff40f9 Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) Pass ================================================================= [7621137] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:22 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621137/ [7621139] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:14 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621139/ [7621140] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:07 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621140/ [7621141] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:57:34 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621141/ [7621143] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:11 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621143/ [7621145] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:42 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621145/ [7621146] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:26 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621146/ [7621147] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 02:02:49 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621147/ [7621148] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:59:06 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621148/ [7621149] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:13 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621149/ [7621150] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:18 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621150/ [7621151] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:56 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621151/ [7621152] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:57:53 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621152/ [7621154] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:59:01 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621154/ [7621155] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 02:00:21 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621155/ [7621156] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:49 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621156/ [7621157] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:13 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621157/ [7621158] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:40 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621158/ [7621159] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:07 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621159/ [7621160] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:57:53 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621160/ [7621161] fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} time: 01:58:33 info: https://pulpito.ceph.com/jcollin-2024-03-25_04:53:04-fs:mirror-wip-jcollin-testing-22032024-distro-default-smithi/7621161/