Publication details

Extraction of Binary Features by Probabilistic Neural Networks

Conference Paper (international conference)

Grim Jiří

serial: Artificial Neural Networks - ICANN 2008, p. 52-61 , Eds: Kůrková V., Neruda R., Koutník J.

action: ICANN 2008. International Conference on Artificial Neural Networks /18./, (Prague, CZ, 03.09.2008-06.09.2008)

research: CEZ:AV0Z10750506

project(s): 1M0572, GA MŠk, 2C06019, GA MŠk, GA102/07/1594, GA ČR

keywords: Probabilistic neural networks, Feature extraction, Recognition of numerals

abstract (eng):

In order to design probabilistic neural networks in the framework of pattern recognition we estimate class-conditional probability distributions in the form of finite mixtures of product components. As the mixture components correspond to neurons we specify the properties of neurons in terms of component parameters. The probabilistic features defined by neuron outputs can be used to transform the classification problem without information loss and, simultaneously, the Shannon entropy of the feature space is minimized. We show that, instead of dimensionality reduction, the decision problem can be simplified by using binary approximation of the probabilistic features. In experiments the resulting binary features improve recognition accuracy but also they are nearly independent - in accordance with the minimum entropy property.

abstract (cze):

Extrakce binárních příznaků pomocí pravděpodobnostních neuronových sítí