Experiments With Spectral Learning of Latent-Variable PCFGs

Loading...
Thumbnail Image
Penn collection
Statistics Papers
Degree type
Discipline
Subject
Computational Linguistics
Linguistics
Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Cohen, Shay B
Stratos, Karl
Collins, Michael
Foster, Dean P
Ungar, Lyle H
Contributor
Abstract

Latent-variable PCFGs (L-PCFGs) are a highly successful model for natural language parsing. Recent work (Cohen et al., 2012) has introduced a spectral algorithm for parameter estimation of L-PCFGs, which - unlike the EM algorithm - is guaranteed to give consistent parameter estimates (it has PAC-style guarantees of sample complexity). This paper describes experiments using the spectral algorithm. We show that the algorithm provides models with the same accuracy as EM, but is an order of magnitude more efficient. We describe a number of key steps used to obtain this level of performance; these should be relevant to other work on the application of spectral learning algorithms. We view our results as strong empirical evidence for the viability of spectral methods as an alternative to EM.

Advisor
Date of presentation
2013-01-01
Conference name
Statistics Papers
Conference dates
2023-05-17T15:29:55.000
Conference location
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection