A Distributed Framework for Mining Financial Data

被引:0
|
作者
Ding, Alan Hong Wai [1 ]
Lau, Phooi Yee [1 ]
Liew, Soung-Yue [1 ]
Teoh, Ee Na [1 ]
Nazir, Amril [2 ]
Chong, Poh Kit [2 ]
Karuppiah, Ettikan K. [2 ]
Yassin, Yaszrina Mohamad [2 ]
机构
[1] Jalan Univ, Univ Tunku Abdul Rahman, Fac Informat & Commun Technol, Kampar 31900, Perak, Malaysia
[2] Technol Pk Malaysia, MIMOS BERHAD, Informat Commun Technol Cluster, Kuala Lumpur 57000, Malaysia
关键词
data mining; distributed processing; open source platform; cloud computing;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Financial institutions are struggling with the challenges of managing and analyzing large dataset, especially if the dataset are accessed and shared among various subsidiaries from different location. These existing organizations, in the past, often employed a centralized control over their dataset as a way to curb data integrity and data solidarity. In this instance, a central processing unit, often a single machine, could consume all resources, else not affording to process the data altogether. To solve these incumbent problems, distributed computing techniques arc being introduced to improve the efficiency of data processing. In this project, we present a framework to distribute processing resources for data mining tool, i.e. to provide the ability to distribute the processes, over a cloud software stack using open source tools and platforms. As a conclusion to this framework, we discussed the open source tools and platforms along with our preliminary investigation results.
引用
收藏
页数:6
相关论文
共 50 条
  • [2] Distributed data mining - Framework and implementations
    Kumar, Anup
    Kantardzic, Mehmed
    Madden, Samuel
    IEEE INTERNET COMPUTING, 2006, 10 (04) : 15 - 17
  • [3] Distributed data mining in a ubiquitous healthcare framework
    Viswanathan, M.
    ADVANCES IN ARTIFICIAL INTELLIGENCE, 2007, 4509 : 261 - 271
  • [4] A framework for distributed data mining heterogeneous classifier
    Urmela, S.
    Nandhini, M.
    COMPUTER COMMUNICATIONS, 2019, 147 : 58 - 75
  • [5] A framework to support distributed data mining on grid
    Gao, Kun
    Xi, Lifeng
    Li, Jifang
    THEORETICAL ADVANCES AND APPLICATIONS OF FUZZY LOGIC AND SOFT COMPUTING, 2007, 42 : 489 - +
  • [6] Admire framework: Distributed data mining on data Grid platforms
    Le-Khac, Nhien-An
    Kechadi, Tahar
    Carthy, Joe
    ICSOFT 2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON SOFTWARE AND DATA TECHNOLOGIES, VOL 2, 2006, : 67 - +
  • [7] An extensible service oriented distributed data mining framework
    Kumar, A
    Kantardzic, M
    Ramaswamy, P
    Sadeghian, P
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA'04), 2004, : 256 - 263
  • [8] Multi-layered framework for distributed data mining
    Serazi, M
    Perera, A
    Ding, Q
    Malakhov, V
    Perrizo, W
    INTELLIGENT AND ADAPTIVE SYSTEMS AND SOFTWARE ENGINEERING, 2004, : 63 - 67
  • [9] A Failure Handling Framework for Distributed Data Mining Services on the Grid
    Cesario, Eugenio
    Talia, Domenico
    PROCEEDINGS OF THE 19TH INTERNATIONAL EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING, 2011, : 70 - 79
  • [10] Parallel and distributed clustering framework for big spatial data mining
    Bendechache, Malika
    Tari, A-Kamel
    Kechadi, M-Tahar
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2019, 34 (06) : 671 - 689