Co-training with Noisy Perceptual Observations

Authors:
Christhoudias, C. Mario
Urtasun, Raquel
Kapoor, Ashish
Darrell, Trevor
Technical Report Identifier: EECS-2009-17
January 27, 2009
EECS-2009-17.pdf

Abstract: Many perception and multimedia indexing problems involve datasets that are naturally comprised of multiple streams or modalities for which supervised training data is only sparsely available. In cases where there is a degree of conditional independence between such views, a class of semi-supervised techniques based on maximizing view agreement over unlabeled data has been proven successful in a wide range of machine learning domains. However, these "co-training" or "multi-view" learning methods have had relatively limited application in vision, due in part to the assumption of constant per-channel noise models. In this paper we propose a probabilistic heteroscedastic approach to co-training that simultaneously discovers the amount of noise in a per example basis, while solving the classification task. This results in high performance in the presence of occlusion or other complex observation noise processes. We demonstrate our approach in two domains, multi-view object recognition from low-fidelity sensor networks and audio-visual classification.