Pixelated a phpBB Template by SkaidonDesigns
 
Cheapest Web Software Support Area Forum Index www.cheapestwebsoftware.com
Play with the Best, be the Best!
Cheapest Web Software
FAQ
Search
Memberlist
Usergroups
Profile
Log in to check your private messages
Log in

The Mightiest Webmaster Solutions Ever
Blogs Organizer
Blogs Organizer
Cheapest Adult Scripts
Cheapest Adult Scripts
Blogs Automater
Blogs Automater
Porn Blog Space
Porn Blog Space

Haven't registered yet? Do it here now!
Setting up a robots.txt file to disallow archive pages

 
Post new topic   Reply to topic    Cheapest Web Software Support Area Forum Index -> Blogs Organizer
View previous topic :: View next topic  
Author Message
darrell



Joined: 09 Jul 2007
Posts: 16

PostPosted: Wed Nov 21, 2007 1:59 pm    Post subject: Setting up a robots.txt file to disallow archive pages Reply with quote
I want to add a robots.txt file to stop search engines indexing the archive pages generated by the command %%NEXT_PAGE%%

The command %%NEXT_PAGE%% produces the url http://www.domain.com/pages-2 then http://www.domain.com/pages-3 etc. I don't think it is possible to add a command to the robots file that will disallow all archive pages and I can't add every archive page to the htaccess file as the file would be huge.

Is it possible to change the url of the archive pages to http://www.domain.com/archives/pages-2 etc. so I can simply add the command Disallow: /archives/ to the robots.txt file?
Back to top
View user's profile Send private message

Author Message
Atanasis
Owner


Joined: 22 May 2004
Posts: 4284
Location: The Net

PostPosted: Wed Nov 21, 2007 3:43 pm    Post subject: Reply with quote
hi there, no its not possible to change the current directory structure in BO, coz it will cause lots of troubles to all users.

what you could do is add in the robots the /pages-2/ just.
when spiders are on index page they will see pages-2 link, but in robots it will be excluded so they won't visit it. next page-3 and etc.. are visible only on deeper pages, not on index, so you should be fine..
_________________
Thanks,
Kaktusan

Back to top
View user's profile Send private message Visit poster's website AIM Address Yahoo Messenger ICQ Number

Display posts from previous:   
Post new topic   Reply to topic    Cheapest Web Software Support Area Forum Index -> Blogs Organizer All times are GMT + 2 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2002 phpBB Group