Robust regression techniques - A useful alternative for the detection of outlier data in chemical analysis

被引:44
|
作者
Ortiz, M. Cruz
Sarabia, Luis A.
Herrero, Ana
机构
[1] Univ Burgos, Fac Sci, Dept Chem, Burgos 09001, Spain
[2] Univ Burgos, Fac Sci, Dept Math & Computat, Burgos 09001, Spain
关键词
robust regression; least median of squares regression; outlier data; capability of detection; capability of discrimination; ISO; 5725-5;
D O I
10.1016/j.talanta.2005.12.058
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The validation of an analytical procedure means the evaluation of some performance criteria such as accuracy, sensitivity, linear range, capability of detection, selectivity, calibration curve, etc. This implies the use of different statistical methodologies, some of them related with statistical regression techniques, which may be robust or not. The presence of outlier data has a significant effect on the determination of sensitivity, linear range or capability of detection amongst others, when these figures of merit are evaluated with non-robust methodologies. In this paper some of the robust methods used for calibration in analytical chemistry are reviewed: the Huber M-estimator; the Andrews, Tukey and Welsh GM-estimators; the fuzzy estimators; the constrained M-estimators, CM; the least trimmed squares, LTS. The paper also shows that the mathematical properties of the least median squares (LMS) regression can be of great interest in the detection of outlier data in chemical analysis. A comparative analysis is made of the results obtained by applying these regression methods to synthetic and real data. There is also a review of some applications where this robust regression works in a suitable and simple way that proves very useful to secure an objective detection of outliers. The use of a robust regression is recommended in ISO 5725-5. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:499 / 512
页数:14
相关论文
共 50 条
  • [1] Outlier detection and robust regression for correlated data
    Yuen, Ka-Veng
    Ortiz, Gilberto A.
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2017, 313 : 632 - 646
  • [2] Robust Functional Regression for Outlier Detection
    Hullait, Harjit
    Leslie, David S.
    Pavlidis, Nicos G.
    King, Steve
    ADVANCED ANALYTICS AND LEARNING ON TEMPORAL DATA, AALTD 2019, 2020, 11986 : 3 - 13
  • [3] OUTLIER DETECTION BY ROBUST ALTERNATING REGRESSION
    UKKELBERG, A
    BORGEN, OS
    ANALYTICA CHIMICA ACTA, 1993, 277 (02) : 489 - 494
  • [4] Outlier detection in chemical data by fractal analysis
    Cramer, JA
    Shah, SS
    Battaglia, TM
    Banerji, SN
    Obando, LA
    Booksh, KS
    JOURNAL OF CHEMOMETRICS, 2004, 18 (7-8) : 317 - 326
  • [5] Robust outlier detection using SVM regression
    Jordaan, EM
    Smits, GF
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 2017 - 2022
  • [6] Outlier Detection and Robust Estimation in Nonparametric Regression
    Kong, Dehan
    Bondell, Howard
    Shen, Weining
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [7] Robust principal component analysis and outlier detection with ecological data
    Jackson, DA
    Chen, Y
    ENVIRONMETRICS, 2004, 15 (02) : 129 - 139
  • [8] Robust SiZer for exploration of regression structures and outlier detection
    Hannig, J
    Lee, TCM
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2006, 15 (01) : 101 - 117
  • [9] Outlier Detection in Logistic Regression and Its Application in Medical Data Analysis
    Ahmad, Sanizah
    Ramli, Norazan Mohamed
    Midi, Habshah
    2012 IEEE COLLOQUIUM ON HUMANITIES, SCIENCE & ENGINEERING RESEARCH (CHUSER 2012), 2012,
  • [10] Outlier Detection by Regression Diagnostics in Large Data
    Nurunnabi, A. A. M.
    Nasser, Mohammed
    INTERNATIONAL CONFERENCE ON FUTURE COMPUTER AND COMMUNICATIONS, PROCEEDINGS, 2009, : 246 - +