Академический Документы
Профессиональный Документы
Культура Документы
1
Neural Network in MATLAB
Bias neurons are added to neural networks to help them learn patterns. As the bias neurons have a constant input of one they
are not connected to the previous layer. a bias value allows you to shift the activation function to the left or right, which
may be critical for successful learning. 2
Neural Network in MATLAB
McCulloch-Pitts Model :
3
Neural Network in MATLAB
Implementation:
Loading data source.
ANN is rarely used for
Selecting attributes required. predictive modelling. The
Decide training, validation, and testing data. reason being that
Artificial Neural Networks
Data manipulations and Target generation. (ANN) usually tries to
over-fit the relationship.
Neural Network creation (selection of network ANN is generally used in
architecture) and initialisation. cases where what has
Network Training and Testing. happened in past is
repeated almost exactly
Performance evaluation. in same way.
4
Neural Network in MATLAB
Here, the network is adjusted, based on a comparison of the output and the target, until
the network output matches the target. Typically many such input/target pairs are used, in
this supervised learning, to train a network.
Batch training of a network proceeds by making weight and bias changes based on an
entire set (batch) of input vectors. Incremental training changes the weights and biases of
a network as needed after presentation of each individual input vector. Incremental
training is sometimes referred to as “on line” or “adaptive” training.
5
Neural Network in MATLAB
6
Neural Network in MATLAB
7
Neural Network in MATLAB
8
Neural Network in MATLAB
MLP: back-propagation
The universal approximation theorem for neural
networks states that every continuous function that
maps intervals of real numbers to some output
interval of real numbers can be approximated
arbitrarily closely by a multi-layer perceptron with
just one hidden layer. This result holds for a wide
range of activation functions, e.g. for the sigmoidal
functions.
Multi-layer networks use a variety of learning techniques, the most popular
being back-propagation. Here, the output values are compared with the
correct answer to compute the value of some predefined error-function. By
various techniques, the error is then fed back through the network. Using
this information, the algorithm adjusts the weights of each connection in
order to reduce the value of the error function by some small amount. After
repeating this process for a sufficiently large number of training cycles, the
network will usually converge to some state where the error of the
calculations is small. In this case, one would say that the network
has learned a certain target function.
9
Neural Network in MATLAB
10
Neural Network in MATLAB
MATLAB Programming tansig
2
Architecture Ʃ 1)=a − 1
( )
g (n1
1 + e −2 n
Ɵ11
Ʃ g (n12)
Ɵ12
Ʃ g (n13)
x1
Ʃ g (n14)
purelin
Ʃ g (n15)
Ʃ g (n21)
x2
Ʃ g (n16)
Ɵ21
x3 Ʃ g (n17)
Ʃ g (n18)
Ʃ g (n19)
Declaration
of [R] Ʃ g (n110 )
Ɵ110
Declaration of [S]
11
Neural Network in MATLAB
Expressions
a = tansig(n) = 2/(1+exp(-2*n))-1
12
Neural Network in MATLAB
Plotting tips
13
Neural Network in MATLAB
Thank You…
14