Support vector machine incremental learning triggered by wrongly predicted samples
CSTR:
Author:
Affiliation:

1. Collaborative Innovation Center of Yangtze River Delta Region Green Pharmaceuticals, Zhejiang University of Technology, Hangzhou 310023, China ;2. College of Computer and Information Technology, China Three Gorges University, Yichang 443002, China;3. College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310032, China;4. Department of Radiology, University of Wisconsin-Madison, Madison 53792, USA

  • Article
  • | |
  • Metrics
  • |
  • Reference [21]
  • |
  • Related
  • | | |
  • Comments
    Abstract:

    According to the classic Karush-Kuhn-Tucker (KKT) theorem, at every step of incremental support vector machine (SVM) learning, the newly adding sample which violates the KKT conditions will be a new support vector (SV) and migrate the old samples between SV set and non-support vector (NSV) set, and at the same time the learning model should be updated based on the SVs. However, it is not exactly clear at this moment that which of the old samples would change between SVs and NSVs. Additionally, the learning model will be unnecessarily updated, which will not greatly increase its accuracy but decrease the training speed. Therefore, how to choose the new SVs from old sets during the incremental stages and when to process incremental steps will greatly influence the accuracy and efficiency of incremental SVM learning. In this work, a new algorithm is proposed to select candidate SVs and use the wrongly predicted sample to trigger the incremental processing simultaneously. Experimental results show that the proposed algorithm can achieve good performance with high efficiency, high speed and good accuracy.

    Reference
    [1] Ade R and Deshmukh P R, International Journal of
    Computer Applications 2, 1039 (2014).
    [2] Yuan Y, Fang J and Wang Q, IEEE Transactions on Cybernetics 45, 548 (2015).
    [3] Omar Abdel Wahab, Azzam Mourad, Hadi Otrok and Jamal Bentahar, Expert Systems with Applications 50, 40 (2016).
    [4] Maoxiang Chu, Jie Zhao, Xiaoping Liu and Rongfen Gong, Chemometrics and Intelligent Laboratory Systems 168, 15 (2017).
    [5] Nilashi M., Ibrahim O. B., Mardani A., Ahani A. and Jusoh A., A Soft Computing Approach for Diabetes Disease Classification, Health Informatics Journal, 2016.
    [6] Ivana Markovi?, Milo? Stojanovi?, Milo? Bo?i? and Jelena Stankovi?, ICT Innovations, 105 (2014).
    [7] Masayuki Karasuyama and Ichiro Takeuchi, Advances in Neural Information Processing Systems, 907 (2009).
    [8] Gert Cauwenberghs and Tomaso Poggio, Incremental and Decremental Support Vector Machine Learning, International Conference on Neural Information Processing Systems, MIT Press, 388 (2000).
    [9] Antoine Bordes, Seyda Ertekin, Jason Weston and Léon Bottou, Journal of Machine Learning Research 6, 1579 (2005).
    [10] Seyda Ertekin, Leon Bottou and C Lee Giles, IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 368 (2011).
    [11] Cunhe Li, Kangwei Liu and Hongxia Wang, Applied Intelligence 34, 19 (2011).
    [12] Bin Gu, Victor S. Sheng, Zhijie Wang, Derek Ho, Said Osman and Shuo Li, Neural Networks 67, 140 (2015).
    [13] Yang Yi, Jiansheng Wu and Wei Xu, Expert Systems with Applications 38, 7698 (2011).
    [14] Roshan Chitrakar and Chuanhe Huang, Computers & Security 45, 231 (2014).
    [15] Fei Gao, Jingyuan Mei, Jinping Sun, Jun Wang, Erfu Yang and Amir Hussain, Plos One 10, e0135709 (2015).
    [16] Wei-Yuan Cheng and Chia-Feng Juang, Fuzzy Sets and Systems 163, 24 (2011).
    [17] YouLong Yang, JinXing Che, YanYing Li, YanJun Zhao and SuLing Zhu, Energy 113, 796 (2016).
    [18] Chih-Chung Chang and Chih-Jen Lin, ACM Transactions on Intelligent Systems and Technology 2, 1 (2001).
    [19] Shaoning Pang, Lei Zhu, Gang Chen, Abdolhossein Sarrafzadeh, Tao Ban and Daisuke Inoue, Neural Networks 44, 87 (2013).
    [20] Bache K and Lichman M, UCI Machine Learning Repository, CA:University of California, School of Information and Computer Science, 2013.
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

TANG Ting-long, GUAN Qiu, WU Yi-rong. Support vector machine incremental learning triggered by wrongly predicted samples[J]. Optoelectronics Letters,2018,14(3):232-235

Copy
Share
Article Metrics
  • Abstract:3766
  • PDF: 0
  • HTML: 0
  • Cited by: 0
History
  • Received:November 29,2017
  • Revised:January 17,2018
  • Online: April 24,2018
Article QR Code