Outlier detection and robust regression for correlated data

被引:47
|
作者
Yuen, Ka-Veng [1 ]
Ortiz, Gilberto A. [1 ]
机构
[1] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Bayesian inference; Correlated noise; Maximum likelihood; Model updating; Outlier detection; BAYESIAN PROBABILISTIC APPROACH; PARAMETER-ESTIMATION; HYSTERETIC SYSTEMS; DYNAMICAL-SYSTEMS; BOOTSTRAP FILTER; IDENTIFICATION; MODELS; UNCERTAINTIES; DISTRIBUTIONS; ALGORITHMS;
D O I
10.1016/j.cma.2016.10.004
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Outlier detection has attracted considerable interest in various areas. Existing outlier detection methods usually assume independence of the modeling errors among the data points but this assumption does not hold in a number of applications. In this paper we propose a probabilistic method for outlier detection and robust updating of linear regression problems involving correlated data. First, suspicious data points will be identified using the minimum volume ellipsoid method and the maximum trimmed likelihood method. Then, the outlierness of each suspicious data point will be determined according to the proposed outlier probability in consideration of possible correlation among the data points. The proposed method is assessed and validated through simulated and real data. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:632 / 646
页数:15
相关论文
共 50 条
  • [41] Outlier detection for batch processes based on partial robust M-regression
    Jia, R.-D. (jiarunda@ise.neu.edu.cn), 1600, Northeast University (34):
  • [42] Robust Multi-Target Regression for Correlated Data Corruption
    Zhang, Xuchao
    Shao, Yingwen
    20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 1406 - 1411
  • [43] Robust statistics for outlier detection
    Rousseeuw, Peter J.
    Hubert, Mia
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2011, 1 (01) : 73 - 79
  • [44] Robust support vector data description for outlier detection with noise or uncertain data
    Chen, Guijun
    Zhang, Xueying
    Wang, Zizhong John
    Li, Fenglian
    KNOWLEDGE-BASED SYSTEMS, 2015, 90 : 129 - 137
  • [45] Robust Local Outlier Detection
    Du, Haizhou
    Zhao, Shengjie
    Zhang, Daqiang
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 116 - 123
  • [46] Outlier robust model selection in linear regression
    Müller, S
    Welsh, AH
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (472) : 1297 - 1310
  • [47] Outlier Detection in Logistic Regression and Its Application in Medical Data Analysis
    Ahmad, Sanizah
    Ramli, Norazan Mohamed
    Midi, Habshah
    2012 IEEE COLLOQUIUM ON HUMANITIES, SCIENCE & ENGINEERING RESEARCH (CHUSER 2012), 2012,
  • [48] The Outlier Detection for Ordinal Data Using Scalling Technique of Regression Coefficients
    Adnan, Arisman
    Sugiarto, Sigit
    INTERNATIONAL CONFERENCE ON MATHEMATICS: EDUCATION, THEORY AND APPLICATION, 2017, 855
  • [49] Detection of outlier and a robust BP algorithm against outlier
    Zhao, WX
    Chen, DZ
    Hu, SX
    COMPUTERS & CHEMICAL ENGINEERING, 2004, 28 (08) : 1403 - 1408
  • [50] Social Classes of Intelligence, Economic Growth and Technological Achievement: Robust Regression and Outlier Detection
    Burhan, Nik Ahmad Sufian
    Razak, Razli Che
    Ibrahim, Saifuzzaman
    Selamat, Muhamad Rosli
    Rosli, Muhamad Ridhwan
    JOURNAL OF INTERDISCIPLINARY ECONOMICS, 2018, 30 (02) : 148 - 163