Using high performance systems to build collections for a digital library

被引：0
|
作者：
Bergmark, D [1 ]
机构：
[1] Cornell Univ, Digital Lab Res Grp, Ithaca, NY 14853 USA
来源：
2002 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, PROCEEDINGS OF THE WORKSHOPS | 2002年
关键词：
D O I：
10.1109/ICPPW.2002.1039762
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Nothing is more distributed than the Web, with its content spread across thousands of servers. High performance hardware and software is essential for an effective down-load, analysis, and organization of this content. We describe our experience with a highly parallel Web crawling system (Mercator) to construct - automatically - collections of scientific resources for the National Science Digital Library.
引用
收藏
页码：431 / 438
页数：8
相关论文
共 50 条
  • [1] Using University Collections in Digital Library Education
    Stewart, Quinn
    Todd, David
    JCDL 09: PROCEEDINGS OF THE 2009 ACM/IEEE JOINT CONFERENCE ON DIGITAL LIBRARIES, 2009, : 477 - 477
  • [2] Knowledge organization systems in Canadian digital library collections
    Shiri, Ali
    CANADIAN JOURNAL OF INFORMATION AND LIBRARY SCIENCE-REVUE CANADIENNE DES SCIENCES DE L INFORMATION ET DE BIBLIOTHECONOMIE, 2005, 29 (04): : 499 - 499
  • [3] Knowledge organisation systems in North American digital library collections
    Shiri, Ali
    Chase-Kruszewski, Sarah
    PROGRAM-ELECTRONIC LIBRARY AND INFORMATION SYSTEMS, 2009, 43 (02) : 121 - 139
  • [4] Interfaces to knowledge organization systems in Canadian digital library collections
    Shiri, A
    Molberg, K
    ONLINE INFORMATION REVIEW, 2005, 29 (06) : 604 - 620
  • [5] How to build a digital library
    Wiley, DL
    ONLINE, 2003, 27 (01): : 77 - 77
  • [6] Browsing large digital library collections using classification hierarchies
    Geffner, S
    Agrawal, D
    El Abbadi, A
    Smith, T
    PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON INFORMATION KNOWLEDGE MANAGEMENT, CIKM'99, 1999, : 195 - 201
  • [7] Using Topic Modeling to Enhance Access to Library Digital Collections
    Cain, Jonathan O.
    JOURNAL OF WEB LIBRARIANSHIP, 2016, 10 (03) : 210 - 225
  • [8] Using distributed objects to build the Stanford Digital Library Infobus
    Paepcke, A
    Baldonado, MQW
    Chang, CCK
    Cousins, S
    Garcia-Molina, H
    COMPUTER, 1999, 32 (02) : 80 - +
  • [9] Enabling complex analysis of large-scale digital collections: humanities research, high-performance computing, and transforming access to British Library digital collections
    Terras, Melissa
    Baker, James
    Hetherington, James
    Beavan, David
    Austwick, Martin Zaltz
    Welsh, Anne
    O'Neill, Helen
    Finley, Will
    Duke-Williams, Oliver
    Farquhar, Adam
    DIGITAL SCHOLARSHIP IN THE HUMANITIES, 2018, 33 (02) : 456 - 466
  • [10] Preserving UK digital library collections
    Beagrie, N
    PROGRAM-ELECTRONIC LIBRARY AND INFORMATION SYSTEMS, 2001, 35 (03) : 217 - 226
12345