February 20th, 2009 |
CafeSaiGon |
522 views |
Using robots.txt, you can ban specific robots, ban all robots, or block robot access to specific pages or areas of your site. If you are not sure what to type, look at the bottom of this page for examples.
An example of SEO optimized robots.txt file (should work on most blogs… just edit the [...]
February 12th, 2009 |
CafeSaiGon |
475 views |
This plugin helps you to create and manage a robots.txt file.
Robots.txt file can have a great influence on SEO blog. By excluding “useless” (for search engines) files from crawling, you can increase your Wordpress blog’s traffic and search engine rankings
An example of SEO optimized robots.txt file (should work on most blogs… just edit the sitemap [...]