VRL an eye

JSEG - Segmentation of color-texture regions in images and video

People

Yining Deng, B.S.Manjunath

Objective

The essential idea of JSEG is to separate the segmentation process into two independently processed stages, color quantization and spatial segmentation. In the first stage, colors in the image are quantized to several representing classes that can be used to differentiate regions in the image. This quantization is performed in the color space alone without considering the spatial distributions. Afterwards, image pixel colors are replaced by their corresponding color class labels, thus forming a class-map of the image. The main focus of this work is on spatial segmentation, where a criterion for "good" segmentation using the class-map is proposed. Applying the criterion to local windows in the class-map results in the "J-image", in which high and low values correspond to possible boundaries and interiors of color-texture regions. A region growing method is then used to segment the image based on the multi-scale J-images. For video sequences, a region tracking scheme is embedded into region growing and problems of motion estimation are avoided. The goal is to achieve consistent segmentation and tracking results, even for scenes with arbitrary non-rigid object motion. Experiments show the robustness of the JSEG algorithm on real images and video.

Examples

Both the original and the segmented images are shown in these examples.

Software

» Binary and source download.

Publications

These materials are presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each authors copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. Y.Deng, and B.S.Manjunath, "Unsupervised segmentation of color-texture regions in images and video," IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI '01), August 2001. [abstract] Y.Deng, B.S.Manjunath and H.Shin "Color image segmentation", Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR '99, Fort Collins, CO, vol.2, pp.446-51, June 1999. [abstract] Y. Deng and B.S.Manjunath, "An efficient low-dimensional color indexing scheme for region based image retrieval,"Proc. IEEE Intl. Conference on Acoustics, Speech and Signal Processing (ICASSP-99), Phoenix, Arizona, March 1999. [abstract]