Home » Forum
  • If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

Announcement

Collapse
No announcement yet.

noindex and no follow

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • noindex and no follow

    Is there a way to get Zoom to obey:

    Code:
    <meta name="robots" content="noindex">
    and this one too:

    Code:
     <meta name="robots" content="no follow">
    ...I understand that one may put Zoom tags on pages, but if I am crawling sites that are not my own, then I have no control over inserting Zoom tags. Furthermore, if Zoom does not obey noindex and no follow, when crawling other people's sites, then my IP could be banned from crawling their sites. That's not a good thing.

    If there is not presently (in V5) an option to have Zoom obey noindex and nofollow, will this feature be added in V5.1 or V5.2?

  • #2
    It is on our list of things to do. V5.1 is a likely candidate for this feature.


    UPDATE
    This feature was added in V5.1 of Zoom, 15/June/2007.
    Zoom will obey meta robots tags for "noindex" and "nofollow", e.g.
    <meta name="robots" content="noindex">
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

    Comment


    • #3
      Originally posted by Ray View Post
      It is on our list of things to do. V5.1 is a likely candidate for this feature.
      Ray, sounds good! Also, I am wondering how to get the search engine to perform searches like:

      site:mywebsite.com

      on a search engine that has several different web-sites crawled an indexed together. Is this possible? Is this something that will come out in V5.1?

      Comment


      • #4
        At the moment it is not possible to do this. At least not without doing some modifications on the scripts. If there is enough demand we would implement it in a future release. But there hasn't been to date.

        Comment


        • #5
          Originally posted by wrensoft View Post
          At the moment it is not possible to do this. At least not without doing some modifications on the scripts. If there is enough demand we would implement it in a future release. But there hasn't been to date.
          Well, add me to the list of those demanding it! Kidding. Seriously, I think it should be a standard feature, especially if someone is crawling multiple sites.

          Comment

          Working...
          X