Image segmentation is one of the most important steps leading to the analysis of image data. The goal is dividing the image into parts that have homogeneous attributes, and have a strong correlation with objects or areas of the real world contained in the image. Region-based segmentation methods, e.g., Markov Random Fields (MRFs), are usually robust to noise and easy to capture contextual dependencies, but often generate rough boundaries and hard to incorporate shape and topology constraints. On the other hand, edge-based segmentation methods, e.g., deformable models, are usually easy to incorporate shape prior and object topology, but sensitive to noise (false edges and weak edges) and, sometimes, initializations.
In this project, we are combining deformable models and Markov random fields using a graphical model framework for better image segmentation. The integrated framework takes advantages of both models and generate better segmentation results in many cases.
The tightly coupled model :
The exact (yet intractable) Inference
The variational inference (to decouple the original intractable model inference)
The extended MRF model (solved by the belief propagation algorithm)
The probabilistic deformable model
The optimal variational parameters
The whole segmentation algorithm is an EM algorithm solving the above equations iteratively:
Results
More results in our paper [1]
- A “more” tightly-coupled model (belief propagation inference can be performed in the whole model instead of using the variational inference) [2]
- An extension to 3D segmentation [3]
Publications
- [1] R. Huang, V. Pavlovic and D. N. Metaxas. “A graphical model framework for coupling MRFs and deformable models”. Proc. CVPR. 2004.
- [2] R. Huang, V. Pavlovic and D. N. Metaxas. “A Hybrid Framework for Image Segmentation Using Probabilistic Integration of Heterogeneous Constraints”. Computer Vision for Biomedical Image Application: Current Techniques and Future Trends. 2005.
- [3] R. Huang, V. Pavlovic and D. N. Metaxas. “A tightly coupled region-shape framework for 3D medical image segmentation”. Int’l Symposium Biomedical Imaging. 2006.