Released on: 19, February 2006
, Author: SEO for Google
, Audience: Internet related
I can't tell you how many times I've answered this question inforums, so I figured since so many are asking, it would make for a great article.
First off, let's describe what we are talking about. A "bot" is a piece of softwarefrom a search engine that is built to go through every page of your site, categorizeit, and place it into a database.
Google has three well known bots: The Adsense bot, the Freshbot and the DeepCrawl.
The Adsense bot, as you could probably guess, is used for publishers who haveAdsense on their sites. As soon as a new page is created, the JavaScript within theAdsense code sends a message to the Adsense bot, and it will come within 15 minutesto index the page so that it can serve up the most relevant ads.
But, for this conversation we are only concerned about the DeepCrawl and the Freshbot.
The Freshbot crawls the most popular pages on your website. It doesn't matter ifthat is one page or thousands. Sites like Amazon.com and CNN.com have pages that arecrawled every ten minutes, since Google has learned that those pages have thatamount of frequent changes. A typical site should expect to have a freshbot visitevery 1 to 14 days, depending on how popular those pages are.
What happens to your site on a Freshbot visit is that it finds all of the deeperlinks in your site. It places those links into a database so that when the DeepCrawloccurs, it has a reference.
Once a month, the DeepCrawl bot visits your site and goes over all the links foundby the Freshbot. This is the reason why it can take up to a month for your entiresite to be indexed in Google - even with the addition of a Google Sitemap.
So, be patient and keep on adding content to your site, and work on getting valuablein-bound links to your site - Google will reward you for it.
-To your online success!
Paul Blisswww.SEOforGoogle.com
Source: Express-Press-Release.com
Related downloads
The product indexes your ICQ history with Google Desktop Search
thus enabling you to use amazingly powerful search facilities GDS provides.
The product indexes your ICQ history with Google Desktop Search
thus enabling you to use amazingly powerful search facilities GDS provides.
RankDummy! is a powerful tool to obtain the search engine position and page number of your web sites on the top search engines Google, Yahoo, AOL, Lycos, Altavista, and Looksmart.
Site Map Builder allows you to create the Google SiteMaps XML needed within your root directory in order to provide information about your site to Google. This XML must have some syntax that SiteMapBuilder.NET will generate for you
Create a site map or Yahoo or Google Sitemap Protocol XML for any website or for offline CD/DVD use. Site Map Pro will create a self contained HTML file. Place this file on your site to provide full navigation facilities for your visitors.
SiteMap XML Dynamic SiteMap Generator, is a php based generator for Google, XML, RSS, HTML and Text site maps. It includes a range of configurable variables and can be run as an online form for Static SiteMaps or to create real time Dynamic SiteMaps.
This software is for indexing text files, HTML files, XML files or files of a similar type in multiple folders and their subfolders to allow subsequent quick searching of those files.
A self-contained index-based network search engine that indexes all shared files in your local area network and provides users with the ability to locate necessary files within a few seconds. Built-in web-server and database ensure easy deployment.
The ultimate Database Editor/Utility.dbfUtils is a convenient, full-featured utility for viewing, editing, modifying, converting and exporting DBF-format databasesIt allows you to add, delete, recall, sort, zap, pack records, view and edit tables.
MS Access to MySQL database migration utility convert table structure, indexes, attributes into MySQL format. Software exports key constraints, data field values and supports Unicode architecture and maintains database integrity during conversion.
