2023-11-23T06:43:25.088 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T06:43:25.088 INFO:teuthology.results:seed: '3853' 2023-11-23T06:44:21.020 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T06:44:21.023 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-23T09:04:30.924 INFO:teuthology.results:Tests finished! gathering results... 2023-11-23T09:04:31.226 INFO:scrape:Found 6 jobs 2023-11-23T09:04:31.590 INFO:scrape:Found 1 distinct failure reasons 2023-11-23T09:04:31.591 INFO:scrape:Crash: Test failure: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules), test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-23T09:04:31.591 INFO:scrape:ceph version 18.0.0-7459-g2f2761c6 (2f2761c65a40b6484a5324c33d6a96f969436961) reef (dev) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5b6b242520] 2: pthread_kill() 3: raise() 4: abort() 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2bbe) [0x7f5b6b6a2bbe] 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xae24c) [0x7f5b6b6ae24c] 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xae2b7) [0x7f5b6b6ae2b7] 8: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xae518) [0x7f5b6b6ae518] 9: /usr/lib/ceph/libceph-common.so.2(+0x19ec63) [0x7f5b6bf9ec63] 10: (MgrMonitor::update_from_paxos(bool*)+0x60e) [0x55e88f03b5ce] 11: (Monitor::refresh_from_paxos(bool*)+0x10c) [0x55e88ee61d5c] 12: (Paxos::do_refresh()+0x52) [0x55e88ef685e2] 13: (Paxos::dispatch(boost::intrusive_ptr)+0x421) [0x55e88ef78ba1] 14: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1197) [0x55e88ee90247] 15: (Monitor::_ms_dispatch(Message*)+0x78c) [0x55e88ee90c8c] 16: ceph-mon(+0xb1026e) [0x55e88ee4d26e] 17: (DispatchQueue::entry()+0x5ea) [0x7f5b6c15c10a] 18: /usr/lib/ceph/libceph-common.so.2(+0x3ee931) [0x7f5b6c1ee931] 19: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f5b6b294b43] 20: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f5b6b326a00] 2023-11-23T09:04:31.591 INFO:scrape:1 jobs: ['7464635'] 2023-11-23T09:04:31.591 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/snap-schedule}'] 2023-11-23T09:04:31.591 INFO:scrape: 2023-11-23T09:04:31.591 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 5 Fail ================================================================= [7464635] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 01:33:14 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464635/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464635/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c151f4b816f542ceb261c78ff19b6d2c Test failure: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules), test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Pass ================================================================= [7464634] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 02:05:23 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464634/ [7464636] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 02:07:47 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464636/ [7464637] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 02:06:38 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464637/ [7464638] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 02:10:25 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464638/ [7464639] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 02:05:26 info: https://pulpito.ceph.com/mchangir-2023-11-23_06:42:42-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464639/