Wennerberg
06-26-2005, 09:31 PM
Hi..
When people search for a word, witch is used as a foldername on my website, the search-results shows these index-pages:
http://www.fcbarcelonadk.com/sc2.jpg
And when following the link...
http://www.fcbarcelonadk.com/sc1.jpg
How can I turn this off? I dont want people to enter these index-pages, I want them to stay on the html-pages.
Thanks
You must be pointing the spider to that folder at some point, either as a start URL, or as a link from somewhere else on your website.
Generally, the start URL in spider mode should be pointed at a specific page. For example, http://www.mysite.com/testsite/Spanish/index.html
However, if you point it at a URL such as http://www.mysite.com/testsite/ and there is no default page at that URL (eg. index.html, default.htm, etc.), your web server may generate the file listing that you are seeing.
So the solution is simple: don't point your spider at a folder which has no default page. If you are using it as a start URL, click on the "More" button, select "Edit" for that URL, and change the index options from "Index and follow links" to "Follow links only".
If it is not a start URL that you specified, then check the links on your website. You are most likely linking to the folder somewhere, and that means that normal visitors to your website would also be able to access this folder listing.
Hope that helps.
Powered by vBulletin® Version 4.1.12 Copyright © 2012 vBulletin Solutions, Inc. All rights reserved.