logo
1Zhejiang University, Hangzhou, China 2Youtu Lab, Tencent, Shanghai, China 3Nanyang Technological University, Singapore

Abstract

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity. Mamba-based models, with their superior long-range modeling and linear efficiency, have garnered substantial attention. This study pioneers the application of Mamba to multi-class unsupervised anomaly detection, presenting MambaAD, which consists of a pre-trained encoder and a Mamba decoder featuring Locality-Enhanced State Space (LSS) modules at multi-scales. The proposed LSS module, integrating parallel cascaded (Hybrid State Space) HSS blocks and multi-kernel convolutions operations, effectively captures both long-range and local information. The HSS block, utilizing (Hybrid Scanning) HS encoders, encodes feature maps into five scanning methods and eight directions, thereby strengthening global connections through the (State Space Model) SSM. The use of Hilbert scanning and eight directions significantly improves feature sequence modeling. Comprehensive experiments on six diverse anomaly detection datasets and seven metrics demonstrate SoTA performance, substantiating the method's effectiveness.

Interpolate start reference image.

Qualitative Results

MVTec-AD and VisA Datasets

We conducted qualitative experiments on MVTev-AD and VisA datasets that substantiated the accuracy of our method in anomaly segmentation. The Fig. 4 demonstrates that our method possesses more precise anomaly segmentation capabilities. Compared to DiAD, UniAD and RD4AD, our method delivers more accurate anomaly segmentation, without significant anomaly segmentation bias.

MVTec-AD and VisA dataset.

Quantitative Results

MVTec-AD Dataset

Tab. A1 and Tab. A2 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the MVTec-AD dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

VisA Dataset

Tab. A3 and Tab. A4 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the VisA dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

MVTec-3D AD Dataset

Tab. A5 and Tab. A6 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the MVTec-3D dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

Uni-Medical Dataset

Tab. A7 and Tab. A8 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the Uni-Medical dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

COCO-AD Dataset

Tab. A9 and Tab. A10 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the COCO-AD dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

Real-IAD Dataset

Tab. A11 and Tab. A12 respectively present the results of image-level anomaly detection and pixel-level anomaly localization quantitative outcomes across all categories within the Real-IAD dataset. The results further demonstrate the superiority of our method over various SoTA approaches.

Interpolate start reference image.
Interpolate start reference image.

BibTeX


@article{he2024mambaad,
      title={MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection},
      author={Haoyang He and Yuhu Bai and Jiangning Zhang and Qingdong He and Hongxu Chen and Zhenye Gan and Chengjie Wang and Xiangtai Li and Guanzhong Tian and Lei Xie},
      journal={arXiv preprint arXiv:2404.06564},
      year={2024},
}