www.cheapestwebsoftware.com Play with the Best, be the Best! The Mightiest Webmaster Solutions Ever Cheapest Web Software Cheapest Adult Scripts Gallery Scraper Plug Rush Haven't registered yet? Do it here now! Setting up a robots.txt file to disallow archive pages          Cheapest Web Software Support Area Forum Index -> Blogs Organizer View previous topic :: View next topic   Author Message darrell Joined: 09 Jul 2007 Posts: 16 Posted: Wed Nov 21, 2007 1:59 pm    Post subject: Setting up a robots.txt file to disallow archive pages I want to add a robots.txt file to stop search engines indexing the archive pages generated by the command %%NEXT_PAGE%% The command %%NEXT_PAGE%% produces the url http://www.domain.com/pages-2 then http://www.domain.com/pages-3 etc. I don't think it is possible to add a command to the robots file that will disallow all archive pages and I can't add every archive page to the htaccess file as the file would be huge. Is it possible to change the url of the archive pages to http://www.domain.com/archives/pages-2 etc. so I can simply add the command Disallow: /archives/ to the robots.txt file? Back to top Author Message Atanasis Owner Joined: 22 May 2004 Posts: 4284 Location: The Net Posted: Wed Nov 21, 2007 3:43 pm    Post subject: hi there, no its not possible to change the current directory structure in BO, coz it will cause lots of troubles to all users. what you could do is add in the robots the /pages-2/ just. when spiders are on index page they will see pages-2 link, but in robots it will be excluded so they won't visit it. next page-3 and etc.. are visible only on deeper pages, not on index, so you should be fine.. _________________ Thanks, Kaktusan Back to top Display posts from previous: All Posts1 Day7 Days2 Weeks1 Month3 Months6 Months1 Year Oldest FirstNewest First         Cheapest Web Software Support Area Forum Index -> Blogs Organizer All times are GMT + 2 Hours Page 1 of 1   Jump to: Select a forum Knowledge Base (Read Only)----------------F.A.QBlogs OrganizerBlogs AutomaterLinks OrganizerRocket PingerFeeds Observer Technical Support (Read / Post)----------------Blogs OrganizerBlogs AutomaterLinks OrganizerRocket PingerFeeds Observer  You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum Powered by phpBB © 2001, 2002 phpBB Group