Outlier detection and robust regression for correlated data

被引:47
|
作者
Yuen, Ka-Veng [1 ]
Ortiz, Gilberto A. [1 ]
机构
[1] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Bayesian inference; Correlated noise; Maximum likelihood; Model updating; Outlier detection; BAYESIAN PROBABILISTIC APPROACH; PARAMETER-ESTIMATION; HYSTERETIC SYSTEMS; DYNAMICAL-SYSTEMS; BOOTSTRAP FILTER; IDENTIFICATION; MODELS; UNCERTAINTIES; DISTRIBUTIONS; ALGORITHMS;
D O I
10.1016/j.cma.2016.10.004
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Outlier detection has attracted considerable interest in various areas. Existing outlier detection methods usually assume independence of the modeling errors among the data points but this assumption does not hold in a number of applications. In this paper we propose a probabilistic method for outlier detection and robust updating of linear regression problems involving correlated data. First, suspicious data points will be identified using the minimum volume ellipsoid method and the maximum trimmed likelihood method. Then, the outlierness of each suspicious data point will be determined according to the proposed outlier probability in consideration of possible correlation among the data points. The proposed method is assessed and validated through simulated and real data. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:632 / 646
页数:15
相关论文
共 50 条
  • [1] Robust Functional Regression for Outlier Detection
    Hullait, Harjit
    Leslie, David S.
    Pavlidis, Nicos G.
    King, Steve
    ADVANCED ANALYTICS AND LEARNING ON TEMPORAL DATA, AALTD 2019, 2020, 11986 : 3 - 13
  • [2] OUTLIER DETECTION BY ROBUST ALTERNATING REGRESSION
    UKKELBERG, A
    BORGEN, OS
    ANALYTICA CHIMICA ACTA, 1993, 277 (02) : 489 - 494
  • [3] Robust outlier detection using SVM regression
    Jordaan, EM
    Smits, GF
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 2017 - 2022
  • [4] Outlier Detection and Robust Estimation in Nonparametric Regression
    Kong, Dehan
    Bondell, Howard
    Shen, Weining
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [5] Robust regression techniques - A useful alternative for the detection of outlier data in chemical analysis
    Ortiz, M. Cruz
    Sarabia, Luis A.
    Herrero, Ana
    TALANTA, 2006, 70 (03) : 499 - 512
  • [6] Differentially Private Outlier Detection in Correlated Data
    Degue, Kwassi H.
    Gopalakrishnan, Karthik
    Li, Max Z.
    Balakrishnan, Hamsa
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 2735 - 2742
  • [7] Robust SiZer for exploration of regression structures and outlier detection
    Hannig, J
    Lee, TCM
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2006, 15 (01) : 101 - 117
  • [8] Outlier Detection by Regression Diagnostics in Large Data
    Nurunnabi, A. A. M.
    Nasser, Mohammed
    INTERNATIONAL CONFERENCE ON FUTURE COMPUTER AND COMMUNICATIONS, PROCEEDINGS, 2009, : 246 - +
  • [9] Robust transformations and outlier detection with autocorrelated data
    Cerioli, A
    Riani, M
    FROM DATA AND INFORMATION ANALYSIS TO KNOWLEDGE ENGINEERING, 2006, : 262 - +
  • [10] RODD: Robust Outlier Detection in Data Cubes
    Kuhlmann, Lara
    Wilmes, Daniel
    Mueller, Emmanuel
    Pauly, Markus
    Horn, Daniel
    BIG DATA ANALYTICS AND KNOWLEDGE DISCOVERY, DAWAK 2023, 2023, 14148 : 325 - 339