Journal of University of Science and Technology of China ›› 2016, Vol. 46 ›› Issue (3): 208-214.DOI: 10.3969/j.issn.0253-2778.2016.03.005

• Original Paper • Previous Articles    

An outlier sample eliminating algorithm based on joint XY distances for near infrared spectroscopy analysis

YIN Baoquan, SHI Yinxue, SUN Ruizhi   

  1. 1. Key Laboratory of Agricultural Information Acquisition Technology, Ministry of Agriculture, China Agricultural University, Beijing 100083,China; 2.Yantai Academy of China Agricultural University, Yantai 264000, China
  • Received:2015-08-27 Revised:2015-12-01 Accepted:2015-12-01 Online:2015-12-01 Published:2015-12-01

Abstract: Outlier samples in near infrared spectroscopy analysis can strongly influence on the performance of the prediction model. To detect and eliminate the outlier samples, a new outlier sample eliminating algorithm base on joint XY distances (ODXY) was presented, and the relation of XY distances of NIR is proposed and proved. In this research, 102 lamb samples were collected and the data of NIR spectroscopy and moisture content was measured and analyzed. Initially, Mahalanobis distances method, Monte-Carlo sampling method and ODXY method to were employed to eliminate the outlier samples and built the PLS prediction model based on the processed samples. Then, the predictive mean square error (RMSEP) and the coefficient of determination (R2) were used to test the performance of the prediction model. Finally, the generalization of the eliminating algorithm was tested by new calibration and validation sets. The experiments show that ODXY method has better performance and better generalization ability than the other methods tested in our experiments.

Key words: outlier samples, prediction model, near infrared spectroscopy, Mahalanobis distance, Monte-Carlo sampling method

CLC Number: