| Home | Submit Site | Articles | SEO Guide | Free Website Tools | Login | |
|
|
How Google finds sites and pages?All major search engines use spider programs (also known as crawlers or robots) to scour the web, collect documents, give each a unique reference, scan their text, and hand them off to an indexing program. Where the scan picks up hyperlinks to other documents, those documents are then fetched in their turn. Google’s spider is called Googlebot and you can see it hitting your site if you look at your web logs. A typical Googlebot entry (in the browser section of your logs) might look like this: Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
More on SEO Optimization
|
Related SEO TipsHow to increase google page rank? What is Google Page Rank? Duplicating pages and sites
|
|
|