Automatic Summarization and Keyword Extraction from Web Page or Text File

被引:0
|
作者
You, Xiangdong [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Key Lab Universal Wireless Commun, Minist Educ, Beijing 100876, Peoples R China
关键词
automatic summarization; keyword extraction; readability; textrank;
D O I
10.1109/ccet48361.2019.8989315
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we study the automatic summarization and keyword extraction techniques for web page and text file. First, we use the Readability algorithm to extract the text of the web page, and study the PageRank algorithm and TextRank algorithm, and then use the TextRank algorithm to extract keywords, key sentences and abstracts. We also develop the web application that processes web page and text file. The application can input URL, text file, or text paragraph, then application can complete the extraction of main content, abstract, keywords and key sentences.
引用
收藏
页码:154 / 158
页数:5
相关论文
共 50 条
  • [41] Survey on Automatic Text Summarization
    Li J.
    Zhang C.
    Chen X.
    Hu Y.
    Liao P.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (01): : 1 - 21
  • [42] A Method of Automatic Web Information Extraction Based on Page Clustering
    Yang, Tianqi
    Qiu, Taofen
    2011 9TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2011), 2011, : 390 - 393
  • [43] Automatic Text Summarization Approaches
    Al-Taani, Ahmad T.
    2017 INTERNATIONAL CONFERENCE ON INFOCOM TECHNOLOGIES AND UNMANNED SYSTEMS (TRENDS AND FUTURE DIRECTIONS) (ICTUS), 2017, : 93 - 94
  • [44] Automatic text structuring and summarization
    Salton, G
    Singhal, A
    Mitra, M
    Buckley, C
    INFORMATION PROCESSING & MANAGEMENT, 1997, 33 (02) : 193 - 207
  • [45] Automatic Text Summarization: A review
    Zerari, Naima
    Aitouche, Samia
    Mouss, Mohamed Djamel
    Yaha, Asma
    NINTH INTERNATIONAL CONFERENCE ON INFORMATION, PROCESS, AND KNOWLEDGE MANAGEMENT (EKNOW 2017), 2017, : 20 - 25
  • [46] An answer summarization method based on keyword extraction
    Fan, Qiaoqing
    Fang, Yu
    2016 INTERNATIONAL CONFERENCE ON MEDICINE SCIENCES AND BIOENGINEERING (ICMSB2016), 2017, 8
  • [47] Automated Keyword Extraction and Summarization for Romanian Texts
    Lupea, M. I.
    Mocan, C. M.
    Nandra, C. I.
    Chifu, E. S.
    2024 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, QUALITY AND TESTING, ROBOTICS, AQTR, 2024, : 329 - 334
  • [48] From task to evaluation: an automatic text summarization review
    Lingfeng Lu
    Yang Liu
    Weiqiang Xu
    Huakang Li
    Guozi Sun
    Artificial Intelligence Review, 2023, 56 : 2477 - 2507
  • [49] Keyword extraction for text categorization
    An, JY
    Chen, YPP
    PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON ACTIVE MEDIA TECHNOLOGY (AMT 2005), 2005, : 556 - 561
  • [50] From task to evaluation: an automatic text summarization review
    Lu, Lingfeng
    Liu, Yang
    Xu, Weiqiang
    Li, Huakang
    Sun, Guozi
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (SUPPL 2) : 2477 - 2507