UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation

Khan, Abbas; Asad, Muhammad; Benning, Martin; Roney, Caroline; Slabaugh, Gregory; (2025) CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation. In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). (pp. pp. 1893-1903). IEEE: Tucson, AZ, USA. Green open access

[thumbnail of Mamba_paper_Camera_Ready.pdf]
Preview
Text
Mamba_paper_Camera_Ready.pdf - Accepted Version

Download (9MB) | Preview

Abstract

Convolutional Neural Networks (CNNs) and Transformer-based self-attention models have become the standard for medical image segmentation. This paper demonstrates that convolution and self-attention, while widely used, are not the only effective methods for segmentation. Breaking with convention, we present a Convolution and self-Attention-free Mamba-based seman-tic Segmentation Network named CAMS-Net. Specifically, we design Mamba-based Channel Aggregator and Spatial Aggregator, which are applied independently in each encoder-decoder stage. The Channel Aggregator extracts information across different channels, and the Spatial Ag-gregator learns features across different spatial locations. We also propose a Linearly Interconnected Factorized Mamba (LIFM) block to reduce the computational complexity of a Mamba block and to enhance its decision function by introducing a non-linearity between two factor-ized Mamba blocks. Our model outperforms the existing state-of-the-art CNN, self-attention, and Mamba-based methods on CMR and M&Ms-2 Cardiac segmentation datasets, showing how this innovative, convolution, and self-attention-free method can inspire further research beyond CNN and Transformer paradigms, achieving linear complexity and reducing the number of parameters. Source code and pre-trained models are available at: https://github.com/kabbas570/CAMS-Net.

Type: Proceedings paper
Title: CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
Event: 2025 Winter Conference on Applications of Computer Vision-WACV
Location: AZ, Tucson
Dates: 28 Feb 2025 - 4 Mar 2025
ISBN-13: 979-8-3315-1084-8
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/WACV61041.2025.00191
Publisher version: https://doi.org/10.1109/wacv61041.2025.00191
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Computer Science, Computer Science, Artificial Intelligence, Computer Science, Theory & Methods, Imaging Science & Photographic Technology, Science & Technology, SKIP CONNECTIONS, Technology, TRANSFORMER
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10213417
Downloads since deposit
11Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item