Belief rule based inference methodology for classification based on differential evolution algorithm

doi:10.3969/j.issn.0253-2778.2016.09.008

Abstract

Abstract: A new method, based on belief rule base(BRB) was proposed for constructing a classification system with high performance for classification problems. The existing belief rule base classification system (BRBCS) is flawed because its classification accuracy is limited to the partition number, the parameter training method needs the number of rules given in advance, and the reasoning process does not reflect the correlation between characteristics and results. The belief rule base inference method was thus proposed for classification based on the differential evolutionary algorithm (DEBRM) to solve the classification problems. The proposed method consists of two procedures: belief rule base classification system (BRBCS) and parameter training method. The new method first introduced the construction strategy of BRBCS to determine the number of rules. Then, belief reasoning method was adopted as the inference engine. Finally, the training model for classification which is combined with differential evolutionary algorithm was built. In the experiment analysis, the effectiveness of the method was validated by comparing it with the existing parameter training method, and the rationality of parameters training in comparison of other belief rule base methods for different number of partitions. The classification results show that the proposed method is effective and reasonable.

Key words: belief reasoning method, classification system, parameters training, differential evolutionary algorithm

CLC Number:

TP18

LIU Wanling, WANG Hanjie, FU Yanggeng, YANG Longhao, Wu Yingjie. Belief rule based inference methodology for classification based on differential evolution algorithm[J]. Journal of University of Science and Technology of China, 2016, 46(9): 764-773.

References

［1］
崔彩霞.智能分类方法［M］.北京：气象出版社，2009: 1-216.
[2] CORTES C, VAPNIK V. Support-vector networks [J]. Machine Learning，1995，20(3): 273-297.
[3] PAWLAK Z. Rough sets[J]. International Journal of Computer and Information Sciences，1982，11(5): 341-356.
[4] ZADEH L A. Fuzzy sets [J]. Information and Control，1965，8(3): 338-353.
[5] RISH I. An empirical study of the naive Bayes classifier[J]. Journal of Universal Computer Science, 2001，1(2): 41-46.
[6] COVER T M, HART P E. Nearest neighbor pattern classification [J]. IEEE Transactions on Information Theory，1967，13(1)：21-27.
[7] DASARATHY B V. Nearest neighbor(NN) norms [A]// NN Pattern Classification Techniques. IEEE Computer Society，1991, 9: 1-30.
[8] GUO N R, LI T H S. Construction of a neuron-fuzzy classification model based on feature-extraction approach [J]. Expert Systems with Applications，2011, 38(1): 682-691.
[9] CHI Z, YAN H, PHAM T. Fuzzy Algorithms with Applications to Image Processing and Pattern Recognition［M］. Singapore：World Scientific Publishing，2014.
[10] ISHIBUCHI H, NOZAKI K, TANAKA H. Distributed representation of fuzzy rules and its application to pattern classification [J]. Fuzzy Sets and Systems，1992，52(1)：21-32.
[11] SUN C T. Rule-base structure identification in an adaptive-network based fuzzy inference system [J]. IEEE Transactions on Fuzzy Systems，1994，2(1)：64-73.
[12] YANG J B, LIU J, WANG J, et al. Belief rule-base inference methodology using the evidential reasoning approach-RIMER [J]. IEEE Transactions on Systems, Man, and Cybernetics，2006，36(2)：266-285.
[13] JIAO L M, PAN Q, DENOEUX T, et al. Belief rule-based classification system: extension of FRBCS in belief functions framework [J]. Information Sciences，2015，309：26-49.
[14] YANG J B, LIU J, XU D L, et al. Optimization models for training belief-rule-based systems [J]. IEEE Transactions on Systems, Man, and Cybernetics, 2007，37(4)：569-585.
[15] CHANG L L, ZHOU Z H, YOU Y, et al. Belief rule based expert system for classification problems [J]. Information Sciences，2015，336：75-91.
[16] SUN R. Robust reasoning: Integrating rule-based and similarity-based reasoning [J]. Artificial Intelligence，1995，75(2)：241-295.
[17] WANG Y M, YANG J B, XU D L. Environmental impact assessment using the evidential reasoning approach [J]. European Journal of Operational Research，2006，174(3)：1885-1913.
[18]NOZAKI K, ISHIBUCHI H, TANAKA H. Adaptive fuzzy rule-based classification systems [J]. IEEE Transactions on Fuzzy Systems，1996，4(3)：238-250.

[19] JOUSSELME A L, GRENIER D, BOSS . A new distance between two bodies of evidence[J]. Information Fusion，2001，2(2)：91-101.

[20] FALLAHNEZHAD M, MORADI M H, ZAFERANLOUEI S. A hybrid higher order neural classifier for handling classification problems [J]. Expert Systems with Applications，2011，38(1)：386-393.

()
()

[1]	Ma Yulian, Cui Wenquan. An end-to-end multitask method with two targets for high-frequency price movement prediction [J]. Journal of University of Science and Technology of China, 2021, 51(3): 246-258.
[2]	. Differential privacy protection method for deep learning based on WGAN feedback [J]. Journal of University of Science and Technology of China, 2020, 50(8): 1064-1071.
[3]	GAO Xiang, CHEN Li. Group stochastic gradient descent: A tradeoff between straggler and staleness [J]. Journal of University of Science and Technology of China, 2020, 50(8): 1156-1161.
[4]	. UAV target tracking based on visual attention mechanism [J]. Journal of University of Science and Technology of China, 2020, 50(8): 1162-1169.
[5]	WANG Yue, LI Jing. Research on optimization method of convolutional neural network based on visualization [J]. Journal of University of Science and Technology of China, 2020, 50(7): 959-967.
[6]	. Focused loss-based for imbalanced data scenarios integrated classification methods for CGAN [J]. Journal of University of Science and Technology of China, 2020, 50(7): 968-976.
[7]	ZHANG Yikai, PENG Yong, KONG Wanzeng, WEN Yimin. Fuzzy local coordinate concept factorization with graph regularization [J]. Journal of University of Science and Technology of China, 2020, 50(7): 993-1002.
[8]	SU Shoubao, CHEN Qiuxin, WANG Chishe, LI Zhi. Adaptive fractional order particle swarm optimization using swarm activity feedback and mutation operator [J]. Journal of University of Science and Technology of China, 2020, 50(7): 1026-1034.
[9]	SHI Lukui, GUO Linlin, FANG Zizhe, ZHANG Jun. Parallel ISOMAP algorithm based on Spark [J]. Journal of University of Science and Technology of China, 2019, 49(10): 842-850.
[10]	ZHANG Huimin, YANG Ming, LV Jing. Multifeature hyperspectral image classification based on adaptive kernel joint sparse representation [J]. Journal of University of Science and Technology of China, 2018, 48(4): 298-306.
[11]	RAO Qi, YANG Yan*, TENG Fei. Condition recognition of high-speed train based on multi-view weighted clustering ensemble [J]. Journal of University of Science and Technology of China, 2018, 48(1): 35-41.
[12]	ZHANG Hao, WU Jianxin,. Ensemble max-pooling: Is only the maximum activation useful when pooling [J]. Journal of University of Science and Technology of China, 2017, 47(10): 799-807.
[13]	SHI Lukui, YUAN Bin, LIU Wenhao. Parallel ISOMAP algorithm based on Spark [J]. Journal of University of Science and Technology of China, 2016, 46(9): 711-718.
[14]	QUAN Xin, GU Yuanhua, ZHENG Guansheng, GU Bin. An incremental cost-sensitive support vector machine [J]. Journal of University of Science and Technology of China, 2016, 46(9): 727-735.
[15]	LAI Yuecong, HUANG Tianqiang, LIN Jing. A fast algorithm of image moments in copy-move forgery detection [J]. Journal of University of Science and Technology of China, 2016, 46(9): 743-748.