Probe, cluster, and discover: Focused extraction of QA-Pagelets from the Deep Web Conference Paper uri icon

abstract

  • In this paper, we introduce the concept of a QA-Pagelet to refer to the content region in a dynamic page that contains query matches. We present THOR, a scalable and efficient mining system for discovering and extracting QA-Pagelets from the Deep Web. A unique feature of THOR is its two-phase extraction framework. In the first phase, pages from a deep web site are grouped into distinct clusters of structurally-similar pages. In the second phase, pages from each page cluster are examined through a subtree filtering algorithm that exploits the structural and content similarity at subtree level to identify the QA-Pagelets.

name of conference

  • Proceedings. 20th International Conference on Data Engineering

published proceedings

  • 20TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS

author list (cited authors)

  • Caverlee, J., Liu, L., & Buttler, D.

citation count

  • 17

complete list of authors

  • Caverlee, J||Liu, L||Buttler, D

editor list (cited editors)

  • Özsoyoglu, Z. M., & Zdonik, S. B.

publication date

  • January 2004