MOTC: An Interactive Aid for Multidimensional Hypothesis Generatio
Penn collection
Degree type
Discipline
Subject
data visualition
hypotheses exploration
knowledge discovery in databases
OLAP
prediction analysis
Databases and Information Systems
Other Computer Sciences
Quantitative, Qualitative, Comparative, and Historical Methodologies
Statistical Theory
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Contributor
Abstract
The paper reports on conceptual development in the areas of database mining and knowledge discovery in databases (KDD). Our efforts have also led to a prototype implementation, called MOTC, for exploring hypothesis space in large and complex data sets. Our KDD conceptual development rests on two main principles. First, we use the crosstab representation for working with qualitative data. This is by now standard in on-line analytical processing (OLAP) applications, and we reaffirm it with additional reasons. Second, and innovatively, we use prediction analysis as a measure of goodness for hypotheses. Prediction analysis is an established statistical technique for analysis of associations among qualitative variables. It generalizes and subsumes a large number of other such measures of association, depending on specific assumptions the user is willing to make. As such, it provides a very useful framework for exploring hypothesis space in a KDD context. The paper illustrates these points with an extensive discussion of MOTC.