View Full Version : disallow redirects
11-29-2008, 07:51 AM
Is there an option to disallow all url redirects in V6 and V5?
11-29-2008, 07:57 AM
I am running v6 beta 4 in spider mode with index and follow option set, and I found a lot of irelevant redirected urls being indexed.
11-29-2008, 06:48 PM
Server side re-directs are automatically followed. If you don't want a page in the index (redirected or not), then you should add it to the skip list.
Powered by vBulletin® Version 4.1.12 Copyright © 2013 vBulletin Solutions, Inc. All rights reserved.