PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Agnostic Learning vs. Prior Knowledge Challenge
Isabelle Guyon, Amir Saffari, Gideon Dror and Gavin Cawley
In: IJCNN 2007, 12-17 Aug 2007, Orlando, Florida.

Abstract

Abstract—“When everything fails, ask for additional domain knowledge” is the current motto of machine learning. Therefore, assessing the real added value of prior/domain knowledge is a both deep and practical question. Most commercial data mining programs accept data pre-formatted as a table, each example being encoded as a fixed set of features. Is it worth spending time engineering elaborate features incorporating domain knowledge and/or designing ad hoc algorithms? Or else, can off-the-shelf programs working on simple features encoding the raw data without much domain knowledge do as well or better than skilled data analysts? To answer these questions, we organized a challenge for IJCNN 2007. The participants were allowed to compete in two tracks: The “prior knowledge” (PK) track, for which they had access to the original raw data representation and as much knowledge as possible about the data, and the “agnostic learning” (AL) track for which they were forced to use data pre-formatted as a table with dummy features. The AL vs. PK challenge web site remains open: http://www.agnostic.inf.ethz.ch/.

PDF - PASCAL Members only - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Oral)
Additional Information:An on-line report is available from: http://clopinet.com/isabelle/Projects/agnostic/Results.html
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Theory & Algorithms
ID Code:4037
Deposited By:Isabelle Guyon
Deposited On:25 February 2008