Departmental Papers (CIS)
Date of this Version
2011
Document Type
Conference Paper
Recommended Citation
Paramveer S. Dhillon, Dean Foster, and Lyle Ungar, "Multi-View Learning of Word Embeddings via CCA", . January 2011.
Abstract
NeurRecently, there has been substantial interest in using large amounts of unlabeled data to learn word representations which can then be used as features in supervised classifiers for NLP tasks. However, most current approaches are slow to train, do not model the context of the word, and lack theoretical grounding. In this paper, we present a new learning method, Low Rank Multi-View Learning (LR-MVL) which uses a fast spectral method to estimate low dimensional context-specific word representations from unlabeled data. These representation features can then be used with any supervised learner. LR-MVL is extremely fast, gives guaranteed convergence to a global optimum, is theoretically elegant, and achieves state-ofthe- art performance on named entity recognition (NER) and chunking problems.
Date Posted: 25 July 2012
Comments
Dhillon, P., Foster, D., & Ungar, L. In Neural Information Processing System (NIPS) Conference. 2011.