Deep Energy-Based NARX Models

被引:5
|
作者
Hendriks, Johannes N. [1 ]
Gustafsson, Fredrik K. [2 ]
Ribeiro, Antonio H. [3 ]
Wills, Adrian G. [1 ]
Schon, Thomas B. [2 ]
机构
[1] Univ Newcastle, Sch Engn, Callaghan, NSW, Australia
[2] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
[3] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270901 Belo Horizonte, MG, Brazil
来源
IFAC PAPERSONLINE | 2021年 / 54卷 / 07期
关键词
System Identification; Energy-Based Models; Deep Neural Networks;
D O I
10.1016/j.ifacol.2021.08.410
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is directed towards the problem of learning nonlinear ARX models based on observed input output data. In particular, our interest is in learning a conditional distribution of the current output based on a finite window of past inputs and outputs. To achieve this, we consider the use of so-called energy-based models, which have been developed in allied fields for learning unknown distributions based on data. This energy-based model relies on a general function to describe the distribution, and here we consider a deep neural network for this purpose. The primary benefit of this approach is that it is capable of learning both simple and highly complex noise models, which we demonstrate on simulated and experimental data. Copyright (C) 2021 The Authors.
引用
收藏
页码:505 / 510
页数:6
相关论文
共 50 条
  • [11] ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICA
    Khemakhem, Ilyes
    Monti, Ricardo P.
    Kingma, Diederik P.
    Hyvarinen, Aapo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [12] Deep Structured Energy-Based Image Inpainting
    Altinel, Fazil
    Ozay, Mete
    Okatani, Takayuki
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 423 - 428
  • [13] Reinforcement Learning with Deep Energy-Based Policies
    Haarnoja, Tuomas
    Tang, Haoran
    Abbeel, Pieter
    Levine, Sergey
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [14] Model-Based Planning with Energy-Based Models
    Du, Yilun
    Lin, Toru
    Mordatch, Igor
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [15] Energy-based models for sparse overcomplete representations
    Teh, YW
    Welling, M
    Osindero, S
    Hinton, GE
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 4 (7-8) : 1235 - 1260
  • [16] Towards understanding retrosynthesis by energy-based models
    Sun, Ruoxi
    Dai, Hanjun
    Li, Li
    Kearnes, Steven
    Dai, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [17] Rate -Distortion via Energy-Based Models
    Li, Qing
    Kim, Yongjune
    Guyot, Cyril
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 351 - 351
  • [18] Implicit Generation and Modeling with Energy-Based Models
    Du, Yilun
    Mordatch, Igor
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [19] LOCAL AND NONLOCAL ENERGY-BASED COUPLING MODELS
    Acosta, Gabriel
    Bersetche, Francisco
    Rossi, Julio D.
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2022, 54 (06) : 6288 - 6322
  • [20] Energy-Based Survival Models for Predictive Maintenance
    Holmer, Olov
    Frisk, Erik
    Krysander, Mattias
    IFAC PAPERSONLINE, 2023, 56 (02): : 10862 - 10867