Implementation and Validation of a Master-Slave Distributed Crawler Applied in Internet Information Retrieval

被引：0
|
作者：
Passos, Anderson [1 ]
机构：
[1] Miyazaki Int Coll, Dept Comparat Culture, Miyazaki, Japan
来源：
2012 7TH INTERNATIONAL CONFERENCE ON COMPUTING AND CONVERGENCE TECHNOLOGY (ICCCT2012) | 2012年
关键词：
web crawling; information retrieval; data mining; parallel execution; master-slave; distributed execution;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
This study describes a preliminary research on Information Retrieval (IR) systems. We developed a prototype tool that runs on a master-slave model and uses distributed processing in order to decentralize the workload while retrieving information from the Internet. Later, its viability is demonstrated with a set of executions and the discussion follows with an analysis of the master process overload versus the number of slaves connected.
引用
收藏
页码：870 / 875
页数：6
相关论文
共 50 条
  • [21] Research on Programming Model for "Master-slave Distributed Tasks" of Insect Intelligent Building
    Xue, Guangtong
    Yang, Qiliang
    Xing, Jianchun
    Zhao, Shuo
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 1938 - 1942
  • [22] Dynamic Master-Slave Distributed Algorithm for Cooperative Localization with Low Computational Cost
    Wang, Lei Gang
    Zhang, Tao
    Zeng, Zheng
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1856 - 1860
  • [23] Control design and implementation of a novel master-slave surgery robot system, MicroHand A
    Sang, Hongqiang
    Wang, Shuxin
    Li, Jianmin
    He, Chao
    Zhang, Lin'an
    Wang, Xiaofei
    INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2011, 7 (03): : 334 - 347
  • [24] Design and Implementation of Hot-line Working Robot Master-slave Manipulator
    Lv, Xiao
    Lu, Shou-yin
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO 2012), 2012,
  • [25] Research and application about the master-slave station integration of distributed business application architecture
    Li J.
    Zhang D.
    Dong J.
    Zhang Q.
    Liu H.
    2016, Chinese Society for Electrical Engineering (36): : 43 - 50
  • [26] Multi-agent based distributed computing framework for master-slave particle swarms
    Zheng, Y.-J. (yujun.zheng@computer.org), 1600, Chinese Academy of Sciences (23):
  • [27] Decentralized Master-Slave Operation of Microgrid Using Current Controlled Distributed Generation Sources
    Verma, Vishal
    Talpur, Girish Gowd
    IEEE INTERNATIONAL CONFERENCE ON POWER ELECTRONICS, DRIVES AND ENERGY SYSTEMS (PEDES 2012), 2012,
  • [28] FPGA Implementation of Master-Slave Servo On-Chip Control with Active Disturbance Rejection
    Zheng, Dechun
    Xu, Jiliang
    Xu, Li
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2025, 32 (01): : 330 - 337
  • [29] Implementation of the Master-Slave Windings Scheme for the Low Pulse Ratio Operation in Motor Drivers
    Xiong, Mufeng
    Liang, Zipeng
    Hu, Sideng
    Yao, Wenxi
    He, Xiangning
    2019 IEEE ENERGY CONVERSION CONGRESS AND EXPOSITION (ECCE), 2019, : 2369 - 2373
  • [30] Internet-based bilateral force-feedback telecontrol of hydraulic master-slave robot
    Xiu, Z
    Wu, PD
    Kitagawa, A
    Jing, SY
    Proceedings of the Sixth International Conference on Fluid Power Transmission and Control, 2005, : 704 - 708
12345