Each column shows one of 4 of the 10 cameras at four time instants denoted by k. A target marked with a box is tracked using a Kalman Consensus filter. The camera PTZ parameters are controlled so as to have the target continuously imaged at a high enough resolution.
In this project, we are developing methods for collaborative and opportunistic sensing in distributed camera networks. Consensus-based distributed estimation algorithms have been developed for target tracking and activity recognition. Camera network control has been realized using distributed optimization approaches related to potential games. The project involves active collaboration with
Prof. J. A. Farrell of Electrical Engineering at UCR.
The project is currently funded through ONR grant N000140910666 (Mathematics, Computers, and Information Research). It has been supported in the past by NSF grant ECS-0622176 (Power, Controls and Adaptive Networks) and ARO grant W911NF-07-1-0485 (Computing and Information Sciences Division).
Demos
Cooperative control of a a camera network to focus on a particular target of interest (shown in red box)
Sample Publications
-
Distributed Camera Networks: Integrated Sensing and Analysis for Wide Area Scene Understanding
B. Song, C. Ding, A. Kamal, J. Farrell, A. Roy-Chowdhury, Signal Processing Magazine, May 2011.
-
A Generalized Kalman Consensus Filter for Wide-Area Video Networks
A. T. Kamal, C. Ding, B. Song, J. A. Farrell, A. K. Roy-Chowdhury, IEEE Conference on Decision and Control and European Control Conference, Dec 2011.
-
Optimized Imaging and Target Tracking within a Distributed Camera Network
A. Morye, C. Ding, B. Song, A. Roy-Chowdhury, J. Farrell, American Control Conference, Jun 2011.
-
Tracking and Activity Recognition Through Consensus in Distributed Camera Networks
B. Song, A. Kamal, C. Soto, C. Ding, J. Farrell, A. Roy-Chowdhury, IEEE Trans. on Image Processing, 2010.
-
Distributed Multi-Target Tracking In A Self-Configuring Camera Network
C. Soto, B. Song, A. Roy-Chowdhury, IEEE Computer Vision and Pattern Recognition, 2009.
-
Robust Tracking in A Camera Network: A Multi-Objective Optimization Framework
B. Song, A. Roy-Chowdhury, IEEE Journal on Selected Topics in Signal Processing: Special Issue on Distributed Processing in Vision Networks, August 2008.
-
Multi-Target Tracking Through Opportunistic Camera Control In A Resource Constrained Multimodal Sensor Network
J. Nayak, L. Gonzalez-Argueta, B. Song, A. Roy-Chowdhury, and E. Tuncel, IEEE/ACM Intl. Conf. on Distributed Smart Cameras, 2008.
-
Stochastic Adaptive Tracking In A Camera Network
B. Song, A. Roy-Chowdhury, IEEE Intl. Conf. on Computer Vision, 2007.
-
Closed-loop Tracking and Change Detection in Multi-Activity Sequences
B. Song, N. Vaswani, A. Roy-Chowdhury, IEEE Computer Vision and Pattern Recognition, 2007.