advertise with ongsono.com
 

Submit Sitemap With Robots.txt


SiteMaps.org (to which all the major engines now subscribe) sets a standard for referencing that utilizes the very same robots.txt file. When a spider visits your site and reads your robots.txt file, you can now tell it where to find your sitemap For example (where your sitemap file is called sitemap.xml and is located in the root of your website):
User-agent: *
Sitemap: http://www.yourdomain.com/sitemap.xml
Disallow: /cgi-bin/

The example robots.txt file tells the crawler how to find your sitemap and not to crawl either your cgi-bin directory (containing PERL scripts not intended for the human reader) or your images directory (to save bandwidth). For more information on the robots.txt standard, you can refer to the authoritative website www.robotstxt.org.

Related SEO Tips

What Is Sitemap?
Sitemap is containing an ordered list of all the pages on your site

Rules of creating sitemap
Sitemaps.org defines the standard protocol. There are four compulsory elements

Submit Google Sitemap
Informing google about updates content in your site, through your XML sitemap.