Results 1 to 4 of 4

Thread: Advanced Spider Options

  1. #1
    Join Date
    Jun 2009
    Posts
    12

    Default Advanced Spider Options

    Hello I am trying to import a number of start points and would like to set them to "Follow all links on this page only" I can not find the command for that option. I even set up one start point set it to "Follow all links on this page only" exported it and here is the results

    http://www.interiorhobbies.com/items.asp?Cc=ADAPTOR&iTpStatus=1&Tp=&Bc=, INDEX_AND_FOLLOW, http://www.interiorhobbies.com/

    Thank you

    Mike Eaket

  2. #2
    Join Date
    Dec 2004
    Location
    Sydney, Australia
    Posts
    3,572

    Default

    Seems like there's two problems here that you found.

    First, the Users Guide is missing the documentation for this feature. We'll have to update it to include it.

    The "Follow all links on this page only" option is specified as "FOLLOW_ALL" in the import/export file.

    Second problem is the bug that the "Export" feature is not exporting the "follow all links..." option properly.

    The good news is that it does correctly import the option "FOLLOW_ALL".

    We'll fix the documentation and bug in the next release (V6.0 build 1016). Thank you for bringing it to our attention.
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

  3. #3
    Join Date
    Jun 2009
    Posts
    12

    Default

    I found this in the Sticky : New features in V6

    New spider option: URLTYPE_FOLLOW_ALL (follow all pages to one level for a start point without indexing the start page).

    I belive this is the command for "Follow all links on this page only"

    Mike

    I just want to add this is a great product , it is really going to improve my sites search.

  4. #4
    Join Date
    Dec 2004
    Location
    Sydney, Australia
    Posts
    3,572

    Default

    It should be "FOLLOW_ALL" as mentioned above. We'll fix the post too.
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •