Toward optimal feature selection

Inthispaper,weexamineamethodforfeaturesubsetselectionbasedonInformationTheory.Initially,aframeworkfordeningthetheoreticallyoptimal,butcomputationallyintractable,methodforfeaturesubsetselectionispresented.Weshowthatourgoalshouldbetoeliminateafeatureifitgivesuslittleornoadditionalin