Home Submit Site Articles SEO Guide Free Website Tools Login | |
Submit Sitemap With Robots.txt
SiteMaps.org (to which all the major engines now subscribe) sets a standard for referencing that utilizes the very same robots.txt file. When a spider visits your site and reads your robots.txt file, you can now tell it where to find your sitemap For example (where your sitemap file is called sitemap.xml and is located in the root of your website): The example robots.txt file tells the crawler how to find your sitemap and not to crawl either your cgi-bin directory (containing PERL scripts not intended for the human reader) or your images directory (to save bandwidth). For more information on the robots.txt standard, you can refer to the authoritative website www.robotstxt.org. More on SEO Optimization
|
Related SEO TipsWhat Is Sitemap? Rules of creating sitemap Submit Google Sitemap
|
|