Journal of Liaoning Petrochemical University ›› 2006, Vol. 26 ›› Issue (2): 83-86.

Previous Articles     Next Articles

Design and Implementation of Web Information Extraction System Based on HTMLParser

  

  1. School of Computer and Communication Engineering , Liaoning University of Petroleum & Chemical Technology ,Fushun Liaoning 113001, P .R .China
  • Received:2005-12-02 Published:2006-02-25 Online:2006-02-25

基于HTMLParser 的Web 信息抽取系统的设计与实现

李彦刚, 魏海平＊ , 侯兴华   

  1. 辽宁石油化工大学计算机与通信工程学院, 辽宁抚顺113001
  • 作者简介:李彦刚(1980 -), 男, 河南郑州市, 在读硕士。

PDF

Abstract:

　    The rapid growth of the Web contents increases the need for some automatic tools to help to find the exact information among the magnanimous information sources such as titles , links, emails, pictures etc .The Web pages expressed by HTML, after analyzed by Internet Explorer , are suitable for browse , but not for machine processing as the way of data exchange .The principle of HTM LParser and related knowledge of regular expression , package HTM LParser and regular expression were introduced .Taking extracting email information inside websites as an example , the scheme of design was proposed.The principle of email extraction and key technique were presented.The algorithm of email extraction was given .URL extraction module , email extraction module and storage module were described in detail.The result of extraction is stored in database for the use of data retrieval.

null

Key words: 　Information extraction , 　Regular expression, 　Package HTM LParser , 　Java

摘要：         互联网上信息量的激增, 迫切需要一些自动化的工具帮助人们在海量信息源中迅速找到真正需要的信息, 如标题、链接、email 和图片等, 而HTML 语言所表述的Web 页面经浏览器分析后只适合浏览, 不适合作为一种数据交换的方式由机器处理。介绍了HTMLParser 的原理和java 正则表达式相关知识, 基于HTMLParser 包和正则表达式。以提取网站内部email 信息为例, 提出了Web 信息抽取系统设计方案, 阐述了email 信息抽取的工作原理和关键技术, 给出了email 抽取算法, 并详细介绍了系统的抽取URL、email 和存储模块, 抽取结果保存于数据库中,供机器检索利用。

关键词: 信息抽取, 　正则表达式, 　HTMLParser 包, 　Java

Cite this article

LI Yan -g ang,WEI Hai -ping. Design and Implementation of Web Information Extraction System Based on HTMLParser[J]. Journal of Liaoning Petrochemical University, 2006, 26(2): 83-86.

李彦刚, 魏海平,侯兴华. 基于HTMLParser 的Web 信息抽取系统的设计与实现[J]. 辽宁石油化工大学学报, 2006, 26(2): 83-86.

share this article

0
    /   /   Recommend

Add to citation manager EndNote|Ris|BibTeX

URL: https://journal.lnpu.edu.cn/EN/

         https://journal.lnpu.edu.cn/EN/Y2006/V26/I2/83

Website Copyright © Editorial Department of Journal of Liaoning Petrochemical University

Address: No. 1, west section of Dandong Road, Wanghua District, Fushun City, Liaoning Province Tel:024-56865105 E-mail:lnxuebao@126.com Zip Code:113001

The system is designed and developed by Beijing magtec Technology Development Co., Ltd.