Extracting Structured Data from Web Pages

Nov. 20, 2008 - PRLog -- Many web sites contain large sets of pages generated using a common template or layout. For example, Amazon lays out the author, title, comments, etc. in the same way in all its book pages. The values used to generate the pages (e.g., the author, title,...) typically come from a database.
  In this paper, we study the problem of automatically extracting the database values from the web pages without any learning examples or other similar human input. We formally define the notion of a template, and propose a model that describes how values are encoded into pages using a template. We present an extraction algorithm that uses sets of words that have similar occurrence pattern in the input pages, to construct the template. The constructed template is then used to extract values from the pages. We show experimentally that the extracted values make semantic sense in most cases.

More Screen Scraping Data information,please vist: http://www.knowlesys.com/
Screen Scraping Examples：http://www.knowlesys.com/examples.htm

# # #

Founded in 2003, Knowlesys Software Inc. has provided web data extraction services or softwares to our clients more than 500 times. Our focus is Web Data Extraction. We try to provide the best web data extraction services and softwares in the world.

At Knowlesys we continuous improve our development progress. We build four guides to improve the quality and effective of our daily work: Knowlesys Software Process Guide, Knowlesys Software Design Guide, Knowlesys Solution Framework Guide, Knowlesys Service Process Guide.