eye vision research lab


» 2013-11. Congratulations to Santhosh for receiving the outstanding paper award at the recent ICDSC conference on camera networks. He presented two papers and his tracking paper was among the three selected for the "excellent paper" award.

» 2013-10. Aruna's paper on spine distribution analysis, published in BMC Bioinformatics, is now a "highly accessed article" with over 850 downloads in about four weeks since publication.

»2013-09 Thomas Kuo and Karthiok S. will be presenting at the ICCV 2013 conference. Karthik's paper is on combining eye-tracking analysis with computer vision methods for better detection/recognition. Thomas's work investigates camera calibration using unsynchronized videos. Congratulations to both on their papers.

» 2013-08 Congratulations to Thomas Kuo for successfully defending his PhD research on 8/21. After graduation Thomas will continue to work at Birdeez, which he co-founded, that develops mobile apps to connect people with nature.

» 2013-08. Congatulations to Santhosh for his two accepted papers to the ICDSC 2013 conference. One paper extends the work of Jiejun on search and retrieval in a camera network, and the other paper focuses on multiview distributed tracking.

» 2013-08. Dhilung and Lakshman will be presenting their work on a signal processing based approach to malware analysis at the Annual Computer Security Applications Conference (ACSAC) in December. See "SigMal: A Static Signal Processing Based Malware Triage" for more details.

» 2013-08. Jiejun's paper on multilabel learning accepted for publication in IEEE Trans. Multimedia. "Multi-label Learning with Fused Multimodal Bi-relational Graph," Jiejun Xu, Vignesh Jagadeesh and B.S. Manjunath.

» 2013-08. Vignesh Jagadeesh's Trans. Image Processing Paper accepted! "Robust Segmentation based Tracing using an Adaptive Wrapper for Inducing Priors" describes the work on adaptive tracing, proposes an algorithm that adapts a generic tracing algorithm to an application of interest (biological, medical, surveillance etc..) utilizing priors specific to the application. Co-authors on the paper are: Vignesh Jagadeesh, James Anderson, Bryan Jones, Robert Marc, Steven K Fisher and B.S Manjunath

» 2013-06. Paper on synapse detection accepted for publiction in Pattern Recognition Letters Special Issue. "Synapse Classification and Localization in Electron Micrographs", Vignesh Jagadeesh, James Anderson, Bryan Jones, Robert Marc, Steven K Fisher and B.S Manjunath.

» 2013-06. The 2013 IEEE Transactions Multimedia Best Paper award to Moxley, Mei and Manjunath's paper on video annotations through graph mining.

» 2013-05. Diana Delibaltov will be presenting her segmentation/fusion work at the upcoming MICCAI conference in Nagoya, Japan, in September. Congratulations to Diana!

» 2013-04. Paper accepted for publication in IEEE Transactions Multimedia. The paper by Jiejun et. al. describes a graph based search, re-identification and retrieval of moving objects in a distributed camera network.

» 2013-3. VRL graduate Dr. Wei-Ying Ma delivers the ECE 50th Anniversary Distinguished Lecture, "The Next Frontier for Web Search and Knowledge Mining". Dr. Ma received his PhD in 1997 and is currently an Assistant Managing Director at Microsoft Research Asia, Beijing. (link to YouTube talk)

» 2013-03. Congratulations to Jiejun Xu, Carter De Leo and Vignesh Jagadeesh for completing their PhD. Jiejun has joined HRL in Malibu, Carter is with Google and Vignesh has started working at eBay.

» 2013-01 Two papers accepted to ACM Transactions on Sensor Networks. Thomas Kuo's work is about geo-calbrating fixed camera nodes using mobile devices, and Carter De Leo's paper is about multicamera video summarization.

» 2012-08 Professors Bill Smith and Manjunath awarded a new NIH R01 5 year project to study morphogenesis of developing embryos.

Current research focus is on (a) integration of human and contextual information in analyzing images and video, leading to bio-inspired methods for computer vision; (b) large scale camera networks and associated "big-data" information processing tasks; and (c) bio-medical image informatics. In addition, we continue the work on fundamental problems of segmentation, registration and tracking, and large scale image/video indexing and search, with emphasis on developing robust and scalable methods.

The Bisque image informatics infrastructure, developed by the VRL group and the Center for Bio-Image Informatics is now integrated into the iPlant cyberinfrastructure. Bisque is currently being used in many major laboratories around the world and we are in the process of adding image feature services and indexing services to facilitate large scale image data management.

View Google Scholar Citations for the VRL publications.

Recent Papers

[Camera Networks]

[Bioimage Segmentation/Analysis]

[Malware Analysis]


Current Projects

A Cell

Center for Bio-Image Informatics

High resolution imaging of molecules and cells will be critical for understanding complex systems such as the nervous system, whether it be for the localization of specific neuron types within a region of the central nervous system, the branching pattern of dendritic trees, or the localization of molecules at the subcellular levels. In collaboration with researchers in biology, we are developing new image analysis methods for quantifying complex biological phenomena. For more information about the Center for Bio-Image Informatics and the Bisque open-source system, click on the link above.


eye tracking

Bio-Inspired Visual Analytics

Humans are adept at complex visual tasks such as detection, tracking and recognition. The first aim of this project is to understand humans visual attention mechanism and the factors influencing it. In particular we investigate the importance of scene context and camera focus in attention modeling. We have developed human attention inspired models to build semantic priors for text detection which outperforms state-of-the-art. Current work focuses on integrating fMRI and eye-tracking data, towards developing robust recognition methods.


Interactive and Robust Segmentation

Interactive segmentationRobust methods for segmentation and tracking are critical for quantitative biology. We are developing methods for accurate, automated and interactive 2D/3D segmentation of cellular and sub-cellular structures, with emphasis on high-throughput image analysis. The three main issues that make analyzing microscopic imagery challenging are modeling of cell appearance which varies from one dataset to another, poor signal to noise ratio/clutter, and the large scale nature of the datasets. We have developed interactive static image segmentation methods using Markov Random Fields (MRFs) that utilize a human in the loop to achieve accurate segmentation. Further, we have proposed an approach for parameter adaptation that induces generic high-level priors on topology, facilitating robust tracing of neuronal structures. Recent work focuses on modeling edge appearance and scaling tracing techniques to hundreds of structures. Finally, we have also focused on the problem of detecting deformable structures such as synaptic junctions in Electron Micrographs.

  • M.E. Sargin, A. Altinok, B.S. Manjunath and K. Rose, "Variable Length Open Contour Tracking Using a Deformable Trellis", IEEE Transactions on Image Processing, vol. 20, no. 4, pp. 1023-1035, Apr. 2011.


Spider in a malwareSignal Processing for Malware Analysis

SARVAM is a demonstration of a simple and effective technique for visualizing and classifying malware using image processing. Malware binaries are visualized as gray scale images, with the observation that for many malware families, images belonging to the same family "appear" very similar in their layout and texture. The online demo allows users to upload binary executable files and search for similar malware in the SARVAM database.

A Cell

Large Scale Camera Networks

During the past few years we have set up a wide area camera network, called the SCALLOPSNet (Scalable Large Optical Sensor Network). About 100 stationary cameras covera an expansive area that can be divided into three distinct regions: inside a building, along urban paths, and in a remote natural reserve. Challenging research issues include geo-calibration, multicamera video summarization and anomaly detection, and multi-camera tracking and activity analysis in wide area networks.


Past Projects

A Cell

Interactive Digital Multimedia

Interactive digital multimedia involves a range of technologies and applications centered on the creation, encoding, transmission, storage, presentation, and analysis of multimedia data, as well as the study of human interaction with multimedia systems. more...

See also: IGERT Web Site
A Cell

Managing Multimedia Databases

Our goal is to enable a multimedia system, i.e. an organized, easily accessible, and searchable database of large-scale amount of multimedia data. more...

Demos: Cortina | SpiritTagger | Categorical Image Search | MPEG7 Texture Descriptor
A Cell

Multimedia Data Hiding and Steganalysis

The main objective is to embed as large a signature data as possible into the host signal without causing any significant perceptual distortion in the embedded signal. more...

A Cell

Image Segmentation

The group has developed several automated image segmentation techniques. more...

A Cell

Image Registration and Fusion

Research on image registration addresses issues related to multiscale registration, integrating robust segmentation tools with the contour matching approach, and in developing novel image representation schemes for maintaining large databases of satellite images. more...

Demos: imReg
A Cell

Image Texture

Research on image registration addresses issues related to multiscale registration, integrating robust segmentation tools with the contour matching approach, and in developing novel image representation schemes for maintaining large databases of satellite images. more...

Our Sponsors


NSF Logo ONR Logo Caltrans ICB - Institute for Collaborative Biotechnologies
National Science Foundation Office of Naval Research Caltrans