Robots Exclusion Standard

When primitive robots were first created some of them would crash servers. A robots exclusion standard was crafted to allow you to tell any robot (or all of them) that you do not want some of your pages indexed or that you do not want your links followed. You can do this via a meta tag on the page copy

<meta name="robots" content="noindex,nofollow">

or create a robots.txt file which tells the robots where NOT to go. Click here for the official robots exclusion protocol document.

Related SEO Tips

Controlling Robots or bot
We can control Robots or bot like googlebot, from prevent or allowing to access our site.

Submit Sitemap With Robots.txt
Another way to actively notifying the search engines is thru robots.txt

Search Engine Friendly Web Design
be sure your website have search engine friendly design so your website can be crawl