My home page
Biography
Research
Publications
My group
Courses
Professional activities
FAQ
Personal
Papers

Daphne Koller Publications

Toward Optimal Feature Selection (1996)

by D. Koller and M. Sahami


Abstract: In this paper, we examine a method for feature subset selection based on Information Theory. Initially, a framework for defining the theoretically optimal, but computationally intractable, method for feature subset selection is presented. We show that our goal should be to eliminate a feature if it gives us little or no additional information beyond that subsumed by the remaining features. In particular, this will be the case for both irrelevant and redundant features. We then give an efficient algorithm for feature selection which computes an approximation to the optimal feature selection criterion. The conditions under which the approximate algorithm is successful are examined. Empirical results are given on a number of data sets, showing that the algorithm effectively handles datasets with large numbers of features.


Download Information

D. Koller and M. Sahami (1996). "Toward Optimal Feature Selection." Proceedings of the Thirteenth International Conference on Machine Learning (ICML) (pp. 284-292). pdf ps.gz

Bibtex citation

@inproceedings{Koller+Sahami:ICML96,
  author =       "D. Koller and M. Sahami",
  editor =       "Lorenza Saitta",
  booktitle =    "Proceedings of the Thirteenth International Conference on Machine Learning (ICML)",
  title =        "Toward Optimal Feature Selection",
  publisher =    "Morgan Kaufmann Publishers",
  pages =        "284--292",
  year =         "1996",
}

full list
Click to go to robotics Click to go to theory Click to go to CS Stanford Click to go to Stanford's Webpage
home | biography | research | papers | my group
courses | professional activities | FAQ | personal