Comments on: WordPress Robot.txt – The Correct Way http://howbits.com/wordpress-robottxt-the-correct-way/ Blogging, Tweaks, SEO, Optimizing Sat, 04 Feb 2012 08:25:04 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: distress sales http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-184 distress sales Sat, 29 Nov 2008 21:08:42 +0000 http://howbits.com/?p=145#comment-184 I really like what you had to say here! It\'s about time! Would you mind if I placed a link back from my blog? I really like what you had to say here! It\’s about time! Would you mind if I placed a link back from my blog?

]]> By: Jean-Luc http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-183 Jean-Luc Wed, 12 Nov 2008 04:17:33 +0000 http://howbits.com/?p=145#comment-183 User-agent: Mediapartners-Google* Disallow: This would do exactly the same thing as your long list of non-standard "Allow:" directives following Mediapartners-Google* User-agent: Mediapartners-Google*
Disallow:

This would do exactly the same thing as your long list of non-standard “Allow:” directives following Mediapartners-Google*

]]> By: SEO/SEM blog http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-182 SEO/SEM blog Sun, 31 Aug 2008 12:04:21 +0000 http://howbits.com/?p=145#comment-182 Allow command is not a standard command, yet some search engines follow that rule, like Googlebot. It is not necessary thought as Allow command is default to all search engines. Allow command is not a standard command, yet some search engines follow that rule, like Googlebot. It is not necessary thought as Allow command is default to all search engines.

]]> By: Djames http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-181 Djames Sun, 31 Aug 2008 11:53:17 +0000 http://howbits.com/?p=145#comment-181 In the global disallow area various directories and images are off limits, but I want Google imagebot to index images, and sometimes Googles Mediapartners follow the rules set in place for Google bot, unless you have noted it some where else in the text file. In the global disallow area various directories and images are off limits, but I want Google imagebot to index images, and sometimes Googles Mediapartners follow the rules set in place for Google bot, unless you have noted it some where else in the text file.

]]> By: Djames http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-180 Djames Sun, 31 Aug 2008 11:45:27 +0000 http://howbits.com/?p=145#comment-180 I am 100% certain it has an allow command, like I said, it's helps having a good robots.txt in place. I am 100% certain it has an allow command, like I said, it’s helps having a good robots.txt in place.

]]> By: SEO/SEM blog http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-179 SEO/SEM blog Sun, 31 Aug 2008 11:37:39 +0000 http://howbits.com/?p=145#comment-179 Wait a second, robots.txt does not have Allow command only Disallow right? Wait a second, robots.txt does not have Allow command only Disallow right?

]]> By: PlugIM.com http://howbits.com/wordpress-robottxt-the-correct-way/comment-page-1/#comment-178 PlugIM.com Sun, 31 Aug 2008 04:48:03 +0000 http://howbits.com/?p=145#comment-178 <strong>Wordpress Robot.txt - The Correct Way...</strong> Google will show the theme folder has been indexed along with all the files in wp-content, wp-admin, and cgi-bin folder unless a good Robots.txt is in place. Here is a tutorial for robots.txt file.... WordPress Robot.txt – The Correct Way…

Google will show the theme folder has been indexed along with all the files in wp-content, wp-admin, and cgi-bin folder unless a good Robots.txt is in place. Here is a tutorial for robots.txt file….

]]>