VECTOR QUANTIZATION USING ODE BASED NEURAL NETWORK WITH VARYING VIGILANCE PARAMETER

Author

Ali Dheyaa Khudhair, Southern Illinois University CarbondaleFollow

Date of Award

5-1-2012

Degree Name

Doctor of Philosophy

Department

Electrical and Computer Engineering

First Advisor

Sayeh, Mohammad

Abstract

Vector Quantization importance has been increasing and it is becoming a vital element in the process of classification and clustering of different types of information to help in the development of machines learning and decisions making, however the different techniques that implements Vector Quantization have always come short in some aspects. A lot of researchers have turned their heads towards the idea of creating a Vector Quantization mechanism that is fast and can be used to classify data that is rapidly being generated from some source, most of the mechanisms depend on a specific style of neural networks, this research is one of those attempts. One of the dilemmas that this technology faces is the compromise that has to be made between the accuracy of the results and the speed of the classification or quantization process, also the complexity of the suggested algorithms makes it very hard to implement and realize any of them on a hardware that can be used as a fast-online classifier which can keep up with the speed of the information being presented to the system, an example for such information sources would be high speed processors, and computer networks intrusion detection systems. This research focuses on creating a Vector Quantizer using neural networks, the neural network that is used in this study is a novel one and has a unique feature that comes from the fact that it is based solely on a set of ordinary differential equations. The input data will be injected in those equations and the classification would be based on finding the equilibrium points of the system with the presence of those input patterns. The elimination of conditional statements in this neural network would mean that the implementation and the execution of the classification process of this technique would have one single path that can accommodate any value. A single execution path will provide easier algorithm analysis and open the possibility to realizing it on a pure analog circuit that can have an operation speed able to match the speed of incoming information and classify the data in a real time fashion. The details of this dynamical system will be provided in this research, also the shortcomings that we have faced and how we overcame them will be explained in particulars. Also, a drastic change in the way of looking at the speed vs. accuracy compromise has been made and presented in this research, aiming towards creating a technique that can produce accurate results with high speeds.