Implementation and Validation of a Master-Slave Distributed Crawler Applied in Internet Information Retrieval

被引：0

作者：

Passos, Anderson ^{[1
]}

机构：

[1] Miyazaki Int Coll, Dept Comparat Culture, Miyazaki, Japan

来源：

2012 7TH INTERNATIONAL CONFERENCE ON COMPUTING AND CONVERGENCE TECHNOLOGY (ICCCT2012) | 2012年

关键词：

web crawling; information retrieval; data mining; parallel execution; master-slave; distributed execution;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

This study describes a preliminary research on Information Retrieval (IR) systems. We developed a prototype tool that runs on a master-slave model and uses distributed processing in order to decentralize the workload while retrieving information from the Internet. Later, its viability is demonstrated with a set of executions and the discussion follows with an analysis of the master process overload versus the number of slaves connected.

引用

页码：870 / 875

页数：6

共 50 条

[41] A New Master-Slave based Centralized Control Method for an AC Microgrid with Multiple Distributed Energy Resources
Habibnia, Saba
Mahdavi, Mohammad Saeed
Gharehpetian, G. B.
Ahmadiahangar, Roya
Rosin, Argo
Vinnikov, Dmitri
2022 IEEE 13TH INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS FOR DISTRIBUTED GENERATION SYSTEMS (PEDG), 2022,
[42] A resilient microgrid formation strategy for load restoration considering master-slave distributed generators and topology reconfiguration
Ding, Tao
Lin, Yanling
Bie, Zhaohong
Chen, Chen
APPLIED ENERGY, 2017, 199 : 205 - 216
[43] Short-Term Master-Slave Forecast Method for Distributed Photovoltaic Plants Based on the Spatial Correlation
Ning, Jia
Lu, Guanghao
Hao, Sipeng
Zeng, Aidong
Wang, Hualei
MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
[44] Model and Implementation of Master-Slave Basic Goniometric System for Real Time Control of a Mini Humanoid Robot
Castellanos, Johanna S.
Solaque, Leonardo E.
Mellado Arteche, Martin
CERMA 2008: ELECTRONICS, ROBOTICS AND AUTOMOTIVE MECHANICS CONFERENCE, PROCEEDINGS, 2008, : 502 - 507
[45] Model and Implementation of Master-Slave Basic Goniometric System for Real Time Control of a Mini Humanoid Robot
Johanna, S. Castellanos A.
Leonardo, E. Solaque G.
Arteche, Martin Mellado
CERMA 2008: ELECTRONICS, ROBOTICS AND AUTOMOTIVE MECHANICS CONFERENCE, PROCEEDINGS, 2008, : 598 - +
[46] Performance Analysis of Parallel Master-Slave Evolutionary Strategies (μ,λ) Model Python']Python Implementation for CPU and GPGPU
Zubanovic, D.
Hidic, A.
Hajdarevic, A.
Nosovic, N.
Konjicija, S.
2014 37TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2014, : 1609 - 1613
[47] FOIOTI: An implementation of the conceptualist approach to Internet Information Retrieval
Weideman, M.
SOUTH AFRICAN JOURNAL OF LIBRARIES AND INFORMATION SCIENCE, 2005, 71 (01) : 11 - 25
[48] Internet of health things encryption via master-slave synchronization for stochastic quaternion-valued neural networks
Babu, N. Ramesh
Balasubramaniam, P.
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (05): : 3700 - 3749
[49] An Improved Master-Slave Control for Three port Converter Based Distributed DC Grid connected PV System
Jiang, Siyue
Sun, Kai
Wu, Hongfei
Shi, Haixu
Dong, Xiaofeng
Kazmi, Syed Muhammad Raza
2018 INTERNATIONAL POWER ELECTRONICS CONFERENCE (IPEC-NIIGATA 2018 -ECCE ASIA), 2018, : 4168 - 4173
[50] Dynamic self-configurable master-slave architecture for ad hoc wireless networks with a distributed MAC scheme
Alonso, J
Alonso, L
VTC2004-FALL: 2004 IEEE 60TH VEHICULAR TECHNOLOGY CONFERENCE, VOLS 1-7: WIRELESS TECHNOLOGIES FOR GLOBAL SECURITY, 2004, : 2907 - 2911

← 1 2 3 4 5 →