An Ajax Powered Forms Based Approach For Crawling The Deep Web

Abstract

: The Deep Web is considered as a vital gap in search engine coverage. Large portion
of the web is made up of deep web contents. Many systems and techniques have been proposed to
surface the deep web content. Current techniques do not support crawl based web contents behind
AJAX or JavaScript forms. The AJAX based forms are loaded dynamically at client side script due to
which pre-cashing is not possible. Traditional crawlers are unable to crawl and index dynamic
contents. A solution is presented in this paper to solve this problem. AJAX based forms have been
analyzed to extract the relevant information from database. The information extracted is indexed for
retrieval from database. Further work can be done to accommodate HTML or AJAX based
information.