PDA

View Full Version : How do I spider.....



carltonb
03-27-2005, 09:46 PM
If I want to spider file_a and file_b located at
http://www.myisp.com/files

how would I set the conditions in Start Spider From This URL and Base URL

thanks
carltonb

wrensoft
03-28-2005, 07:33 AM
If I understand you correctly you have two HTML files,

http://www.myisp.com/files/file_a.html
http://www.myisp.com/files/file_b.html

On some web servers you might be able to use the start spider URL of,
http://www.myisp.com/files/
but not all web servers will allow a direct directory listing like this.

If you had an index page on your web site that had HTML links to these two files then you could start the spider on the index page,
http://www.myisp.com/files/index.html

If these files are not linked from any HTML pages, then you might either need to create a new index page, OR add multiple spider start points in Zoom. (using the more button in the main window).

---------
David