[WEB SECURITY] Looking for Addressing some Questions
m_zoroufi at comp.iust.ac.ir
Sun Sep 24 18:24:28 EDT 2006
For my purposes I need a spider/crawler that crawls a web site in a fashion
that I dictate it.
Also I need that this crawling is done through all hyperlinks and submission
So one of the capabilities of desired crawler must be filling the forms and
submitting it to the web server
and analyzing the responses. (the response page that is a client page must
be analyzed and crawled in order to such
other server pages requested by the crawler, this continue till that no
further unvisited server page found!).
I've been looking for an Open source java base crawler that equipped with
the above capabilities or
can be confiqured or customized to do that for me!
If you are familiar with one please identify me with it.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the websecurity