Departmental Papers (CIS)
Date of this Version
December 2004
Document Type
Conference Paper
Recommended Citation
Fei Sha and Lawrence K. Saul, "Real-Time Pitch Determination of One or More Voices by Nonnegative Matrix Factorization", . December 2004.
Abstract
An auditory "scene", composed of overlapping acoustic sources, can be viewed as a complex object whose constituent parts are the individual sources. Pitch is known to be an important cue for auditory scene analysis. In this paper, with the goal of building agents that operate in human environments, we describe a real-time system to identify the presence of one or more voices and compute their pitch. The signal processing in the front end is based on instantaneous frequency estimation, a method for tracking the partials of voiced speech, while the pattern-matching in the back end is based on nonnegative matrix factorization, an unsupervised algorithm for learning the parts of complex objects. While supporting a framework to analyze complicated auditory scenes, our system maintains real-time operability and state-of-the-art performance in clean speech.
Date Posted: 11 September 2005
Comments
Copyright MIT Press. Postprint version. Published in Advances in Neural Information Processing Systems 17, pages 1233-1240. Proceedings of the 18th annual Neural Information Processing Systems (NIPS) conference, held in Vancouver, Canada, from 13-18 December 2004.