NEURAL NETWORKS & LEARNING SYSTEMS

INTRODUCTION

AIM
TO PRESENT ARTIFICIAL NEURAL NETWORKS AND LEARNING SYSTEMS AS A CONTEMPORARY AND FUTURISTIC METHOD OF COMPUTATION

SCOPE
INTRODUCTION

AIM
PART 1 : NEURAL NETWORKS BIOLOGICAL NEURAL NETWORKS ARTIFICIAL NEURAL NETWORKS PART 2 : LEARNING AND PARADIGMS SUPERVISED UNSUPERVISED REINFORCEMENT PART 3 : APPLICATIONS AND DISADVANTAGES PART 4 : CONCLUSION

PART 1

BIOLOGICAL NEURAL NETWORKS

 SERIES OF INTER CONNECTED NEURONS AXONS CONNECTED VIA SYNAPSES TO DENDRITES ON OTHER NEURONS NEURONS HAS 3 MAIN PARTS: AXONS

DENDRITES
SYNAPSES FORM PROCESSING ELEMENTS OF BNN SIMPLE BIO NEURAL NETWORK

 AXON
LONG SLENDER PROJECTION OF NEURON CONDUCT ELETRICAL IMPULSES FROM SOMA TO OTHER NEURONS IMPULSES CALLED ACTION POTENTIALS

DENDRITE
BRANCHED PROJECTIONS OF NEURON CONDUCT ELECTROCHEMICAL IMPULSES FROM OTHER NEURONS TO THE SOMA FROM WHICH THEY ARE PROJECTING

INTEGRATE SYNAPTIC INPUTS

DETERMINE THE EXTENT TO WHICH ACTION POTENTIALS ARE PRODUCED BY NEURON

CAPABLE OF TAKING OVER SOME FUNCTIONS OF AXONS AS WELL

 SYNAPSE
PERMITS NEURON TO PASS ELECTROCHEMICAL IMPULSE TO OTHER
NEURONS NOT CONTINUOUS THROUGHOUT THE BODY. YET CAPABLE OF COMMUNICATING WITH EACH OTHER ORIGIN FROM GREEK WORD SYNAPTEIN

CONNECTED NEURONS IN A NETWORK

ARTIFICIAL NEURAL NETWORKS

A NETWORK OF SIMPLE PROCESSING ELEMENTS THAT EXHIBIT COMPLEX BY GLOBAL BEHAVIOR BETWEEN ELEMENT

DETERMINED PROCESSING PARAMETERS

CONNECTIONS AND

ELEMENTS

EXAMPLE

3 LAYERS MULTIPLE INPUTS, SINGLE OUT PUT SINGLE HIDDEN LAYER ARROWS INDICATE DEPENDANCIES A TOTALLY NEW INFO PROCESSING PARADIGM

WHAT IS A ANN ?
INSPIRED BY WORKING OF BNN

NETWORK WITH NEURODES INTERCONNETED

DESIGNED TO WORK TOGETHER FOR SOLVING COMPLEX PROBLEMS

NEURODES OR UNITS OR PROCESSING ELEMENTS IN ANN SIMILAR TO NEURONS FOUND IN BNN

TYPES OF ANN
FEED FORWARD NETWORK RADIAL BASIS FUNCTION NETWORK KOHONEN SELF ORG NETWORK

LEARNING VECTOR QUANTISATION

RECURRENT NEURAL NETWORK MODULAR NEURAL NETWORK PHYSICAL NEURAL NETWORK

FEED FORWARD NEURAL NETWORK

FIRST AND SIMPLEST FORM INFO MOVES ONLY FWD NO CYCLES OR LOOPS EXAMPLE : SIMPLE PERCEPTRON

RADIAL BASIS FUNCTION NETWORK

KOHONEN SELF ORG NETWORK

LEARNING VECTOR QUANTISATION

RECURRENT NEURAL NETWORK

MODULAR NEURAL NETWORK

PHYSICAL NEURAL NETWORK

PART 2

LEARNING & PARADIGMS

LEARNING
GIVEN A SPECIFIC PROBLEM AND A SET OF FUNCTIONS TO SOLVE THE PROBLEM, LEARNING IMPLIES USING A SET OF

OBSERVATIONS

TO FIND

OUT WHICH

SOLVES THE PROBLEM IN AN OPTIMAL

MANNER OR SENSE

PARAMETERS INVOLVED