Академический Документы
Профессиональный Документы
Культура Документы
com
Expert Systems
with Applications
Expert Systems with Applications 36 (2009) 33553366
www.elsevier.com/locate/eswa
Abstract
Bank failures threaten the economic system as a whole. Therefore, predicting bank nancial failures is crucial to prevent and/or lessen
the incoming negative eects on the economic system. This is originally a classication problem to categorize banks as healthy or nonhealthy ones. This study aims to apply various neural network techniques, support vector machines and multivariate statistical methods
to the bank failure prediction problem in a Turkish case, and to present a comprehensive computational comparison of the classication
performances of the techniques tested. Twenty nancial ratios with six feature groups including capital adequacy, asset quality, management quality, earnings, liquidity and sensitivity to market risk (CAMELS) are selected as predictor variables in the study. Four dierent
data sets with dierent characteristics are developed using ocial nancial data to improve the prediction performance. Each data set is
also divided into training and validation sets. In the category of neural networks, four dierent architectures namely multi-layer perceptron, competitive learning, self-organizing map and learning vector quantization are employed. The multivariate statistical methods;
multivariate discriminant analysis, k-means cluster analysis and logistic regression analysis are tested. Experimental results are evaluated
with respect to the correct accuracy performance of techniques. Results show that multi-layer perceptron and learning vector quantization can be considered as the most successful models in predicting the nancial failure of banks.
2008 Elsevier Ltd. All rights reserved.
Keywords: Bankruptcy prediction; Financial failure; Banking; Savings deposit insurance fund; Articial neural networks; Support vector machines;
Multivariate statistical analysis
1. Introduction
The Turkish banking sector was severely tested in the
aftermath of the 1994 nancial crisis. The banks that carried a signicant short position in foreign exchange position, mismatch of maturities had to incur large losses and
faced liquidity problems as a result of a major run on
deposits. Three small banks were put on liquidation process in April 1994, which triggered further deposit with*
Corresponding author. Tel.: +90 332 2233099; fax: +90 332 3522722.
E-mail address: melekacar@yahoo.com (M.A. Boyacioglu).
0957-4174/$ - see front matter 2008 Elsevier Ltd. All rights reserved.
doi:10.1016/j.eswa.2008.01.003
3356
3357
3358
The literature dealing with the failure prediction problem using support vector machines (SVMs) is relatively
small compared with statistical methods and neural networks. Shin, Lee, and Kim (2005) used SVMs for predicting the corporate bankruptcy and compared the results
with BPNN. They showed that the accuracy and generalization performance of SVMs is better than that of BPNN
as the training set size gets smaller. Min and Lee (2005)
applied SVMs to the bankruptcy prediction problem in
an attempt to suggest a new model with better explanatory
power and stability. They compared the performance their
model with DA, logit, and three-layer fully connected
BPNN. Their experiment results showed that SVMs outperforms the other methods. Min, Lee, and Han (2006)
proposed methods for improving SVMs performance in
two aspects: feature subset selection and parameter optimization. They used genetic algorithms (GA) to optimize
both a feature subset and parameters of SVM simultaneously for bankruptcy prediction. Recently, Wu, Tzeng,
Goo, and Fang (2007) used a real-valued GA to optimize
the parameters of SVMs for predicting bankruptcy and
tested their model on the prediction of nancial crisis in
Taiwan to compare the accuracy of the proposed GASVMs model with that of other models in multivariate statistics (DA, logit, and probit) and articial intelligence (NN
and SVMs). They showed that the GA-SVM model performs the best predictive accuracy, implying that integrating the real-valued GA with traditional SVMs model is
very successful. In general, the studies that used SVM to
predict nancial failure show that SVMs is better than neural networks and statistical methods in predicting the
bankruptcy.
In addition to the statistical methods, neural networks
and support vector machines, there are various intelligent
techniques including case-based reasoning, decision trees,
operational research, evolutionary approaches, rough set
based techniques, soft computing techniques and other
techniques subsuming fuzzy logic and isotonic separation
developed for bankruptcy prediction in the literature. The
review paper of Kumar and Ravi (2007) that summarizes
the related literature can be useful for interested readers.
3. Research design and methodology
3.1. Data set development
A total of 20 nancial ratios with six feature groups
including capital adequacy, asset quality, management
quality, earnings, liquidity and sensitivity to market risk
(CAMELS2) are selected as classiers in the study. These
nancial ratios in six groups with their codes are as follows:
2
Entire set
Training set
Validation set
Failed
Non-failed
Failed
Non-failed
Failed
Non-failed
1997
1998
1999
2000
2001
2002
2003
2004
1
1
6
3
8
1
1
0
2
2
12
6
16
2
2
2
0
1
4
2
5
1
1
0
1
1
8
4
11
1
2
1
1
0
2
1
3
0
0
0
1
1
4
2
5
1
0
1
Total
21
44
14
29
15
Mean
Ratio
Failed
Nonfailed
tstatistic
Ratio
Failed
Nonfailed
tstatistic
CA1
CA2
CA3
AQ1
AQ2
AQ3
AQ4
AQ5
M1
E1
1.59
4.28
1.42
10.97
36.18
22.65
10.57
31.51
3.37
6.55
10.18
51.08
8.69
8.77
27.13
14.42
5.92
35.54
3.30
5.28
2.54*
2.57*
3.46***
1.14ns
2.66*
0.70ns
0.70ns
0.61ns
0.14ns
3.20**
E2
E3
E4
E5
L1
L3
SMR1
SMR2
SMR3
SMR4
131.40
62.06
402.21
84.12
45.73
43.02
10.97
2.08
12.78
286.39
60.16
73.88
204.59
41.41
56.11
81.92
19.33
19.21
13.27
166.23
2.00 *
1.47ns
0.57ns
0.36ns
1.99ns
3.51***
3.21**
2.44*
0.15ns
1.66ns
ns
*
**
***
Not signicant.
p < .05.
p < .01.
p < .001.
3359
Chi-Square
d.f.
Signicance
0.537
963.082
190
0.000
3360
Table 4
Eigenvalues of factors
Factors
1
2
3
4
5
6
7
8
9
10
Initial Eigenvalues
Factors
Total
% of Variance
Cumulative (%)
4.261
3.204
2.825
2.100
1.393
1.239
1.055
0.805
0.721
0.556
21.303
16.022
14.124
10.501
6.967
6.194
5.274
4.023
3.606
2.781
21.303
37.325
51.449
61.949
68.916
75.110
80.384
84.406
88.012
90.793
the capital adequacy. All the ratios grouped under this factor have also positive loadings. Any increase in the value of
these ratios will lead to increase in the score of the capital
adequacy factor. The third factor includes the ratios E4 and
E5 which are related to protability. This factor explains
the percentage of 14.12 of total change. It represents the
protability factor. All the ratios grouped under this factor
have also positive loadings. Increase in the value of these
ratios will lead to increase in the score of the protability
factor. The fourth factor which explains 10.5% of total variance, includes active quality ratio AQ2 and liquidity ratio
L1. In terms of conceptual meaningfulness this factor has
the specications of a mixed factor. The fth factor
includes the protability ratio E4, active quality ratio
AQ5 and sensibility to market risk ratios SMR1 and
SMR2. This factor explains 6.96% of total variance and
represents sensibility to market risk. The sixth factor
includes protability ratio E2 and sensibility to market risk
ratio SMR3. In terms of conceptual meaningfulness this
factor has the specications of mixed factor. The seventh
factor includes only sensibility to market risk ratio
SMR4. The scores of these seven factors were used as independent variables in applying the multivariate statistical
methods.
The output variable of the models is the status of banks
failed or non-failed. The classication accuracy of classication techniques is the measure of prediction performance. This performance measure is the ratio of the
number of correctly classied banks to the number of
incorrectly classied banks. In this study, the classication
accuracy is calculated for training and validation data sets
separately. However, when evaluating the performance of
any technique, its performance in validation data sets is
considered as primary measures. The experiments using
statistical methods are performed using SPSS while neural
network and SVMs experiments are performed in
MATLAB.
3.2. Articial neural networks
Articial neural networks (ANNs) is massively parallelized computing systems that have the ability to learn from
11
12
13
14
15
16
17
18
19
20
Initial Eigenvalues
Total
% of Variance
Cumulative (%)
0.457
0.346
0.294
0.223
0.180
0.135
0.110
4.165E02
3.332E02
2.163E02
2.286
1.728
1.470
1.116
0.900
0.673
0.551
0.208
0.167
0.108
93.079
94.807
96.276
97.393
98.293
98.966
99.517
99.725
99.892
100.000
3361
where D is a discriminant score, Bo is an estimated constant, Bn are the estimated coecients, and Xn are the variables. Based on this discriminant function score, an
observation is classied into the appropriate group.
In this study, MDA is applied to the research data in
order to characterize the group dierences and to classify
the banks group membership which are not known. Initially, Boxs M-test performed to test the validity of the
presumption of equality of group covariance matrices on
the data set. According to the results of Boxs M-test,
group covariance matrices are not homogenous (Boxs
M = 186.26, p 6 0.001). This means that the use of quadratic discriminant analysis on the data which does not
presume the homogeneity of the group covariance matrices
is appropriate.
The second method employed in the study is K-Means
Cluster Analysis (CA) which attempts to classify a set of
observations into groups like MDA. However, unlike
MDA, neither the number of groups nor the group memberships are known in CA. CA attempts to identify homogeneous groups of observations based on the selected
characteristics using an algorithm. This algorithm requires
the researcher to specify the number of clusters. The units
are divided into k cluster, where the calculation of squares
in clusters is to be the minimum. If each of X1, X2, . . . , Xn
values of p dierential observation vectors are considered
as points in the multidimensional X space, and in the same
3362
eZ i
1
1 euZ i 1 euZ i
where xi, xj are vectors in the input space, xTi implies the
transpose of vector xi, using the above polynomial kernel
function. SVMs correctly classied the 95.34% of banks
in the training set and 90.90% of banks in the validation
set.
Based on the results of factor analysis presented in the
previous section, in the experiments where multivariate statistical methods are tested, seven factors were employed as
predictor variables. In MDA experiments, a canonic discriminant function which increases the grouping ability
and minimizes Wilks Lambda was obtained. The eigenvalue (0.654) shows that the estimated discriminant model
has quite high discriminating ability. Canonical correlation
(0.629) is the measure of degree of association between Discores and the grouping variable. The Wilks Lambda
value (0.605) shows the statistical importance of discriminant function or the quality of categorizing units into
groups. The smaller this value the bigger the categorizing
power of functions. The categorizing power of the function
is quite high (p = 0.009). As a result of MDA experiments,
the following discriminant model was obtained:
Table 5
Performance results for training and validation of prediction techniques
Prediction model
Data set
100.00
58.14
58.14
83.72
95.34
88.37
86.04
86.04
95.50
68.18
63.63
100.00
90.90
68.18
81.81
81.81
3363
Table 6
ANOVA results of CA
Cluster
C1
C2
C3
C4
C5
C6
C7
Error
Mean square
df
Mean square
6.380
0.076
0.930
17.024
17.876
0.000
1.433
1
1
1
1
1
1
1
0.915
10015
10001
0.746
0.732
1.016
0.993
63
63
63
63
63
63
63
Sig.
6.975
0.075
0.929
22.831
24.417
0.000
1.443
0.010
0.785
0.339
0.000
0.000
0.988
0.234
Table 7
Results of LRA experiments
Predictor
Coecient
Standard
error
Zstatistic
Signicance
Odds
ratio
Constant
F1
F2
F3
F4
F5
F6
F7
1.216
1.637
3.770
5.407
2.116
3.016
2.813
1.2433
1.062
1.826
1.846
3.759
1.170
1.629
1.720
0.7257
1.15
0.90
2.04
1.44
1.81
1.85
1.64
1.71
0.252
0.370
0.041
0.150
0.071
0.064
0.102
0.087
0.19
0.02
223.02
8.30
0.05
0.06
0.29
3364
Table A.1
Banks taken over by the SDIF and current status thereof
Banks
Date of Transfer
Current Status
Merged
Egebank
Yurtbank
Yasarbank
Bank Kapital
Ulusal Bank
Interbank
Esbank
Iktisat Bank
Kentbank
EGS Bank
Etibank
Toprakbank
Pamukbank
Sold banks
Bank Ekspres
December 12,1998
Demirbank
Sumerbank
Sitebank
Tarisbank
Bayindirbank
(Birlesik Fon
Bankasi)
It was sold to the Tekfen Group on June 30, 2001. Merger of Bank Ekspres A.S. with Tekfen A.S. was
approved by BRSA on October 18, 2001. It carries on its activities as Tekfenbank A.S
A share transfer agreement was signed with HSBC Bank Plc. on September 20, 2001 and actual share
transfer was realized on October 30, 2001
Merged Sumerbank was sold to the OYAK Group on August 9, 2001. The transfer of Sumerbank to
Oyakbank A.S. was registered on January 11, 2002. It carries on its activities as Oyakbank A.S
A share transfer agreement was signed with Novabank on December 20, 2001 and share transfer was
realized on January 25, 2002
The share transfer agreement regarding its transfer to Denizbank A.S. was signed on October 21, 2002
and actual share transfer was completed on October 25, 2002. Merger of Denizbank A.S. with
Tarisbank was approved by the BRSA on December 19, 2002 and merger was completed on October
27, 2002
Pursuant to the Resolution No. 346 dated June 15, 2001 of BRSA, license of Turkbank to perform
banking activities and accept deposits were revoked as of July 1, 2001 and within the scope of the
Articles concerning dissolution and transfer of the Turkish Commercial Code and the Article 18 of the
Abolished Bank Acts and the bank master agreement, the liquidation of the bank was decided to be
realized. Upon the Resolution date August 9, 2002 of the Extraordinary General Meeting and
registered on August 14, 2002, the liquidation transaction of the bank is continuing
It is determined as a bridge bank to carry out the function of asset management and banks title
designated in main contract was changed as Birlesik Fon Bankasi A.S. in accordance with the
Article No. 109 of the Banking Law No. 5411 and the Resolution No. 515 dated December 7, 2005 of
the Fund Board
The banks of which operating permission has been revoked and for which a bankruptcy decision has been adopted
Banks
Date on which the
Date of
Current status
operating permission
bankruptcy
revoked
decision
The banks of which operating has been revoked according to the abolished banks Act No. 4389
Kibris Kredi
September 27, 2000
August 23,
Bankruptcy of the bank has been judged pursuant to the Decree No. 2002/590 of
Bankasi
2004
the Istanbul Commercial Court of First Instance on August 23, 2004. Its
liquidation is going on
Imar Bankasi
July 03, 2003
June 08, 2005
Bankruptcy of the bank has been judged pursuant to the Decree adjudicated with
the File No. 2004/132 of the Istanbul Commercial Court of First Instance on
August 08, 2005. Its liquidation is going on
3365
Date of
bankruptcy
decision
Current status
The banks of which operating has been revoked according to the abolished banks Act No. 3182
Marmara April 20, 1994
June 05, 1995
Bankruptcy of the bank has been judged pursuant to the Decree No. 1994/1425 of the
Bank
Istanbul Commercial Court of First Instance
TYT
April 11, 1994
December 2, 1996 Bankruptcy of the bank has been judged pursuant to the Decree No. 1994/1402 of the
Bank
Istanbul Commercial Court of First Instance
Impex
April 23, 1994
October 22, 1996 Bankruptcy of the bank has been judged pursuant to the Decree No. 1994/1395 of the
Bank
Istanbul Commercial Court of First Instance
References
Aktas, R., Doganay, M. M., & Yildiz, B. (2003). Predicting the nancial
failure: A comparison of statistical methods and neural networks.
Ankara University Journal of SBF, 58, 124.
Alam, P., Booth, L. K., & Thordason, T. (2000). The use of fuzzy
clustering algorithm and self-organizing neural networks for identifying potentially failing banks: An experimental study. Expert Systems
with Applications, 18, 185199.
Altman, E. I. (1968). Financial ratios, discriminant analysis and the
prediction of corporate bankruptcy. The Journal of Finance, 23,
589609.
Altman, E. I. (1977). Predicting performance in the savings and loan
association industry. Journal of Monetary Economics, 3, 443466.
Altman, E. I., Marco, G., & Varetto, F. (1994). Corporate distress
diagnosis: Comparisons using linear discriminant analysis and neural
networks (the Italian experience). Journal of Banking and Finance, 18,
505529.
Atiya, A. F. (2001). Bankruptcy prediction for credit risk using neural
networks: A survey and new results. IEEE Transactions on Neural
Networks, 12(4), 929935.
Baek, J., & Cho, S. (2003). Bankruptcy prediction for credit risk using an
auto associative neural network in Korean rms. In IEEE international
conference on computational intelligence for nancial engineering.
Banking Regulation and Supervision Agency. (2001). Towards a sound
Turkish banking sector.
Banking Regulation and Supervision Agency. (2003). Banking sector
restructuring program progress report VII.
Barniv, R., Anurag, A., & Leach, R. (1997). Predicting the out come
following bankruptcy ling: A three state classication using NN.
International Journal of Intelligent Systems in Accounting, Finance and
Management, 6, 177194.
Bell, T. B. (1997). Neural nets or the logit model? A comparison of each
models ability to predict commercial bank failures. International
Journal of Intelligent Systems in Accounting, Finance and Management,
6, 249264.
Bose, N. K., & Liang, P. (1996). Neural network fundamentals with graphs.
Algorithms, and applications. USA: McGraw-Hill.
Canbas, S., Cabuk, A., & Kilic, S. B. (2005). Prediction of commercial
bank failure via multivariate statistical analysis of nancial structure:
The Turkish case. European Journal of Operational Research, 166,
528546.
Chu, C. H. (1993). Manufacturing cell formation by competitive learning.
International Journal of Production Research, 31, 829843.
Chu, C. H. (1997). An improved neural network for manufacturing cell
formation. Decision Support Systems, 20, 279295.
Doganay, M. M., Ceylan, N. B., & Aktas, R. (2006). Predicting nancial
failure of the Turkish banks. Annals of Financial Economics, 1, 97117.
Fletcher, D., & Goss, E. (1993). Application forecasting with neural
networks an application using bankruptcy data. Information and
Management, 24, 159167.
Fu, L. (1994). Neural networks in computer intelligence. USA: McGrawHill.
3366
Min, S. H., Lee, J., & Han, I. (2006). Hybrid genetic algorithms and
support vector machines for bankruptcy prediction. Expert Systems
with Applications, 31, 652660.
Montgomery, H., Hanh, T. B., Santoso, W., & Besar, D. S. (2005).
Coordinated failure? A cross-country bank failure prediction Model.
ADB Institute Discussion Paper No. 32.
Neaupane, K. M., & Adhikari, N. R. (2006). Prediction of tunnelinginduced ground movement with the multi-layer perceptron. Tunneling
and Underground Space Technology, 21, 151159.
Odom, M., & Sharda, R. (1990). A neural network model for bankruptcy
prediction. In Proceedings of the second IEEE international joint
conference on neural networks (Vol. II, pp. 163168).
Ohlson, J. A. (1980). Financial rations and the probabilistic prediction of
bankruptcy. Journal of Accounting Research, 18, 109131.
Piramuthu, S., Ragavan, H., & Shaw, M. J. (1998). Using feature
construction to improve the performance of the neural networks.
Management Science, 44(3).
Rao, H. A., & Gu, P. (1994). Expert self-organizing neural network for the
design of cellular manufacturing systems. Journal of Manufacturing
Systems, 13, 346358.
Rumelhart, D. E., & McClelland, J. L.PDP Group. (1989). Parallel
distributed processing: exploration in the microstructure of cognition
(Vol. 1). MA: MIT Press.
Salchenberger, L., Mine, C., & Lash, N. (1992). Neural networks: A tool
for predicting thrift failures. Decision Sciences, 23, 899916.
Savings Deposit Insurance Fund. (2006). Annual report 2005.
Seo, K. K. (2007). An application of one-class support vector machines in
content-based image retrieval. Expert Systems with Applications, 33,
491498.
Serrano-Cinca, C. (1996). Self organizing neural networks for nancial
diagnosis. Decision Support Systems, 17, 227238.
Sharda, R. & Wilson, R. L. (1993). Performance comparison issues
in neural network experiments for classication problems. In
Proceedings of the 26th Hawaii international conference on system
scientists.
Shin, K. S., Lee, T. S., & Kim, H. (2005). An application of support vector
machines in bankruptcy prediction model. Expert Systems with
Applications, 28, 127135.
Sinkey, J. F. (1975). A multivariate statistical analysis of the characteristics of problem banks. Journal of Finance, 30, 2136.
Swicegood, P., & Clark, J. A. (2001). O-site monitoring for predicting
bank under performance: A comparison of neural networks, discriminant analysis and professional human judgment. International Journal