Configuring Competing Classifier Chains in Distributed Stream Mining Systems

被引:8
|
作者
Fu, Fangwen [1 ]
Turaga, Deepak S. [2 ]
Verscheure, Olivier [2 ]
van der Schaar, Mihaela [1 ]
Amini, Lisa [2 ]
机构
[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA
[2] IBM TJ Watson Res Ctr, Hawthorne, NY 10532 USA
关键词
Nash bargaining solutions; networked classifiers; resource management; stream mining;
D O I
10.1109/JSTSP.2007.909368
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Networks of classifiers are capturing the attention of system and algorithmic researchers because they offer improved accuracy over single model classifiers, can be distributed over a network of servers for improved scalability, and can be adapted to available system resources. In this paper, we develop algorithms to optimally configure networks (chains) of such classifiers given system processing resource constraints. We first formally define a global performance metric for classifier chains by trading off the end-to-end probabilities of detection and false alarm. We then design centralized and distributed algorithms to provide efficient and fair resource allocation among several classifier chains competing for system resources. We use the Nash Bargaining Solution from game theory to ensure this. We also extend our algorithms to consider arbitrary topologies of classifier chains (with shared classifiers among competing chains). We present results for both simulated and state-of-the-art classifier chains for speaker verification operating on real telephony data, discuss the convergence of our algorithms to the optimal solution, and present interesting directions for future research.
引用
收藏
页码:548 / 563
页数:16
相关论文
共 50 条
  • [41] Supervised Learning Classifier Systems for Grid Data Mining
    Santos, M. F.
    Mathew, W.
    Kovacs, T.
    Santos, H.
    PROCEEDINGS OF THE 15TH AMERICAN CONFERENCE ON APPLIED MATHEMATICS AND PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTATIONAL AND INFORMATION SCIENCES 2009, VOLS I AND II, 2009, : 416 - +
  • [42] Modeling Dynamical Systems with Data Stream Mining
    Osojnik, Aljaz
    Panov, Pance
    Dzeroski, Saso
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2016, 13 (02) : 453 - 473
  • [43] Specification Mining in Concurrent and Distributed Systems
    Kumar, Sandeep
    2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, : 1161 - 1163
  • [44] Specification Mining in Concurrent and Distributed Systems
    Kumar, Sandeep
    2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, : 1086 - 1089
  • [45] Reliable stream data processing for elastic distributed stream processing systems
    Xiaohui Wei
    Yuan Zhuang
    Hongliang Li
    Zhiliang Liu
    Cluster Computing, 2020, 23 : 555 - 574
  • [46] Benchmarking Distributed Stream Data Processing Systems
    Karimov, Jeyhun
    Rabl, Tilmann
    Katsifodimos, Asterios
    Samarev, Roman
    Heiskanen, Henri
    Markl, Volker
    2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 1507 - 1518
  • [47] Accommodating Bursts in Distributed Stream Processing Systems
    Drougas, Yannis
    Kalogeraki, Vana
    2009 IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL & DISTRIBUTED PROCESSING, VOLS 1-5, 2009, : 362 - 372
  • [48] Tracing Distributed Data Stream Processing Systems
    Zvara, Zoltan
    Szabo, Peter G. N.
    Hermann, Gabor
    Benczur, Andras
    2017 IEEE 2ND INTERNATIONAL WORKSHOPS ON FOUNDATIONS AND APPLICATIONS OF SELF* SYSTEMS (FAS*W), 2017, : 235 - 242
  • [49] Reliable stream data processing for elastic distributed stream processing systems
    Wei, Xiaohui
    Zhuang, Yuan
    Li, Hongliang
    Liu, Zhiliang
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (02): : 555 - 574
  • [50] Rethinking the design of distributed stream processing systems
    Zhou, Yongluan
    Aberer, Karl
    Salehi, Ali
    Tan, Kian-Lee
    2008 IEEE 24TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOP, VOLS 1 AND 2, 2008, : 182 - +