Comments on: You’re a sneaky one Google Sitemap Generator http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/ Learning how to optimize, one rung at a time. Wed, 20 Aug 2008 18:17:21 +0000 http://wordpress.org/?v=2.2.3 By: Chris Gray http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-987 Chris Gray Fri, 07 Sep 2007 14:05:50 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-987 @Rob - I know, I am in the same boat. I tend to make a number of changes all at once...so I never know which change had the biggest impact. I guess I should be a little more scientific when testing out a new change. Thanks again for sharing your experience with your sitemap/robots.txt. @Rob - I know, I am in the same boat. I tend to make a number of changes all at once…so I never know which change had the biggest impact. I guess I should be a little more scientific when testing out a new change.

Thanks again for sharing your experience with your sitemap/robots.txt.

]]> By: Rob Cubbon - freelance graphic designer http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-688 Rob Cubbon - freelance graphic designer Thu, 23 Aug 2007 07:39:09 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-688 The good news is my traffic from Google seems to have increased. Unfortunately I made the Google Sitemap at more or less the same time as I tweaked my robots.txt so I don't really know which one has made the difference. Will keep you posted if there are any further developments. Once again, thanks for the tips! The good news is my traffic from Google seems to have increased. Unfortunately I made the Google Sitemap at more or less the same time as I tweaked my robots.txt so I don’t really know which one has made the difference.

Will keep you posted if there are any further developments.

Once again, thanks for the tips!

]]> By: Chris Gray http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-665 Chris Gray Wed, 22 Aug 2007 02:44:26 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-665 @Rob - awesome, hope it helps keep you out of the supplemental index! I just <a href="http://www.google.com/search?hl=en&q=site%3Aseoladder.com&btnG=Search" rel="nofollow">checked my site</a> and these steps appear to have helped reduce the number of pages I have in there at the moment. I still have a few but I expect them to fall out over time. I would enjoy hearing about your results (after tweaking your robots.txt). @Rob - awesome, hope it helps keep you out of the supplemental index! I just checked my site and these steps appear to have helped reduce the number of pages I have in there at the moment. I still have a few but I expect them to fall out over time. I would enjoy hearing about your results (after tweaking your robots.txt).

]]> By: Rob Cubbon - freelance graphic designer http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-658 Rob Cubbon - freelance graphic designer Tue, 21 Aug 2007 19:23:02 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-658 Have disallowed /category/ and /archives/ in my robots.txt – thanks so much for this, Chris. Have disallowed /category/ and /archives/ in my robots.txt – thanks so much for this, Chris.

]]> By: Chris Gray http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-637 Chris Gray Tue, 21 Aug 2007 01:52:49 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-637 <p>@Rob - I exclude /category/ in my robots.txt because I publish full text in my category links (so disallowing "/category/" in robots.txt prevents search engines from indexing duplicate content). That also goes for my sitemap as well...I do not include categories in my sitemap for the same reason.</p> <p>@LaurenMarie - Glad to be of some assistance :) More and more, I am finding that WordPress plug-ins do not always contain the best "default values" and I end up having to test pretty thoroughly before activating them. Hope the Google SiteMap plug-in works out well for you!</p> <p>@kristarella - No problem at all :) I am not 100% sure what you mean by "sucking bandwidth" but this should reduce the probability that you will <a href="http://www.seoladder.com/2007/05/10/one-way-to-avoid-googles-supplemental-index/" rel="nofollow">end up in the supplemental index</a>. If you are concerned about the rate at which Google indexes your site you can adjust the "Crawl rate" in Google's Webmaster Tools control panel.</p> @Rob - I exclude /category/ in my robots.txt because I publish full text in my category links (so disallowing “/category/” in robots.txt prevents search engines from indexing duplicate content). That also goes for my sitemap as well…I do not include categories in my sitemap for the same reason.

@LaurenMarie - Glad to be of some assistance :) More and more, I am finding that WordPress plug-ins do not always contain the best “default values” and I end up having to test pretty thoroughly before activating them. Hope the Google SiteMap plug-in works out well for you!

@kristarella - No problem at all :) I am not 100% sure what you mean by “sucking bandwidth” but this should reduce the probability that you will end up in the supplemental index. If you are concerned about the rate at which Google indexes your site you can adjust the “Crawl rate” in Google’s Webmaster Tools control panel.

]]> By: kristarella http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-496 kristarella Sun, 12 Aug 2007 20:46:19 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-496 Thanks for that! Might be a way to stop Google sucking more bandwidth :) Thanks for that! Might be a way to stop Google sucking more bandwidth :)

]]> By: LaurenMarie - Creative Curio http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-493 LaurenMarie - Creative Curio Sun, 12 Aug 2007 16:06:37 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-493 I followed the link over from David's site. Thank you for posting this! I'm going to install the plugin per David's recommendation and you have helped me avoid the evil duplicate content ;) I followed the link over from David’s site. Thank you for posting this! I’m going to install the plugin per David’s recommendation and you have helped me avoid the evil duplicate content ;)

]]> By: Rob Cubbon - freelance graphic designer http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-491 Rob Cubbon - freelance graphic designer Sun, 12 Aug 2007 13:52:49 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-491 Chris, Thanks for this I have amended my "Includings" accordingly. Do you think Disallow: /category/ is necessary in robots.txt ? Chris, Thanks for this I have amended my “Includings” accordingly. Do you think Disallow: /category/ is necessary in robots.txt ?

]]> By: David Airey :: Graphic Designer » Top 5 essential WordPress Plugins http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-445 David Airey :: Graphic Designer » Top 5 essential WordPress Plugins Tue, 07 Aug 2007 20:51:38 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-445 [...] Chris gives us an important Plugin tip for the sitemap generator [...] […] Chris gives us an important Plugin tip for the sitemap generator […]

]]> By: Chris Gray http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-73 Chris Gray Tue, 12 Jun 2007 10:28:58 +0000 http://www.seoladder.com/2007/06/07/how-to-avoid-googles-supplimental-index-follow-up/#comment-73 kichus - you are correct, I missed /category/...thanks! I will add this one today. Thanks for the catch. kichus - you are correct, I missed /category/…thanks! I will add this one today. Thanks for the catch.

]]>