SAM3D: Segment Anything Model in Volumetric Medical Images (2309.03493v4)
Abstract: Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen to prominence, showcasing exceptional proficiency in processing medical imagery. Motivated by the Segment Anything Model (SAM)-a foundational model renowned for its remarkable precision and robust generalization capabilities in segmenting 2D natural images-we introduce SAM3D, an innovative adaptation tailored for 3D volumetric medical image analysis. Unlike current SAM-based methods that segment volumetric data by converting the volume into separate 2D slices for individual analysis, our SAM3D model processes the entire 3D volume image in a unified approach. Extensive experiments are conducted on multiple medical image datasets to demonstrate that our network attains competitive results compared with other state-of-the-art methods in 3D medical segmentation tasks while being significantly efficient in terms of parameters. Code and checkpoints are available at https://github.com/UARK-AICV/SAM3D.
- “U-Net: Convolutional Networks for Biomedical Image Segmentation,” in MICCAI, 2015.
- “nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation,” Nature Methods, vol. 18, 2021.
- “TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation,” arXiv preprint arXiv:2102.04306, 2021.
- “Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation,” in ECCVW, 2022.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
- “UNETR: Transformers for 3D Medical Image Segmentation,” in WACV, 2022.
- “Hiformer: Hierarchical multi-scale representations using transformers for medical image segmentation,” in WACV, 2023.
- “Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: Is the problem solved?,” IEEE Transactions on Medical Imaging, 2018.
- “Multi-Atlas Labeling Beyond the Cranial Vault - Workshop and Challenge,” in MICCAI Multi-Atlas Labeling Beyond Cranial Vault—Workshop Challenge, 2015.
- “A large annotated medical image dataset for the development and evaluation of segmentation algorithms,” arXiv preprint arXiv:1902.09063, 2019.
- “MISSFormer: An Effective Medical Image Segmentation Transformer,” arXiv preprint arXiv:2109.07162, 2021.
- “TransDeepLab: Convolution-Free Transformer-based DeepLab v3+ for Medical Image Segmentation,” in PRIME, 2022.
- “Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images,” arXiv preprint arXiv:2201.01266, 2022.
- “nnFormer: Interleaved Transformer for Volumetric Segmentation,” arXiv preprint arXiv:2109.03201, 2021.
- “UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation,” arXiv:2212.04497, 2022.
- “Segment Anything,” arXiv:2304.02643, 2023.
- “Customized Segment Anything Model for Medical Image Segmentation,” arXiv preprint arXiv:2304.13785, 2023.
- “Segment anything in medical images,” arXiv preprint arXiv:2304.12306, 2023.
- “Deep Residual Learning for Image Recognition,” in CVPR, 2016.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
