Results 1 to 6 of 6

Thread: How does Google crawl works and index pages

  1. #1
    Join Date
    Dec 2009
    Posts
    33

    How does Google crawl works and index pages

    I am having one one question regarding the Google index policy . I have Created website and wanted to know what is then Google Index policy and how fast Google Crawl work to index a page on Google. I am not having enough idea about same. So if you are having any knowledge regarding same then do let me know. A help may be appreciated.

  2. #2
    Join Date
    Nov 2009
    Posts
    1,340

    Re: How does Google crawl works and index pages

    The Google Spider / Bot is a program dedicated 24 hour to travel the Web for new pages and new content to analyze and display the results. Not indexed yet, because there is no request. Just pick them up and sends them to Crawler which analyzes and stores in its database. Mark when it has passed, what it contains, where it is hosted, etc. The Spider Crawler collects and analyzes the page for storage. This process happens constantly, and Google only shows results that you have stored. So if your page has not been previously scanned and analyzed by the Crawler, not ever appear in search results.

  3. #3
    Join Date
    Jun 2009
    Posts
    705

    Re: How does Google crawl works and index pages

    Once a page has been traced, the subject touches that Google's famous "indexing." Indexing is a more complex process by which Google scans the page and sorts the index according to their relevance to a keyword. It performs several steps as the elimination of "stopwords" not indexed as "the, of, the, in" and so on. It also uses an algorithm for lexicon which is capable of parsing and indexing words with suffixes, prefixes, tenses, synonyms, and so on. Always remember that Google's philosophy is strongly oriented towards the user, and you write your web pages for users, not bots. No need to write "buy cheap Mallorca find bargains." You can type perfectly "find the best deals and fly to Mallorca for very little." In fact, Google will appreciate the use of synonyms.

  4. #4
    Join Date
    May 2008
    Posts
    669

    Re: How does Google crawl works and index pages

    Once the user enters into www.google.com you want to search, that information is sent to Google's server, which is made up of thousands of computers on the internet. Once there, the request is sent to the servers that hold indexes, which seek the servers that hold the pages where the content is consistent with the request that the user has made, hence the importance of proper indexing for Google shows us in the search results. Once this request is sent to servers containing copies of the pages that Google has visited, which speeds up the process. Subsequently all the information it generates the list of search results (SERP) showing the user information. This whole network to send requests, search for pages that gather the information required by the user and finally the sample of results is performed in less than a second, so it is clear why the efficiency of this algorithm.

  5. #5
    Join Date
    May 2008
    Posts
    346

    Re: How does Google crawl works and index pages

    Tracking robots have other names: spiders crawling, crawlers, or bots crawlers. But in the end are just automated programs that crawl the Web, looking for web sites and pages that compose them, and in general all the files you can find on the net. Robots crawl the web travel and visit different websites in a generally random. Different factors may influence visits, including the content and quantity, and frequency of updates you have. So, spiders visits crawlers can be occasional or very frequent. But even occasional visits, they always come and verify changes in the content of the website or pages, changes, deletions, additions, etc.

    The spider and Google crawling robot called Googlebot, and in fact not a single spider, ie no single Googlebot, but several copies of it originating from different machines at Google. The spider crawl of Yahoo Slurp is named, and the spider crawl Bing MSNBot called by its origins in the now defunct Microsoft Live Search.

  6. #6
    Join Date
    Nov 2009
    Posts
    1,191

    Re: How does Google crawl works and index pages

    Indexing search engines is the collection, evaluation, packaging and storage of information so as to facilitate and ensure fast and accurate access to its content. Search within these indices will ensure that relevant information can be recovered following the criteria used. Most search engines index your site currently contain thousands of millions of documents indexed, Google is probably the one with the most.

    The way the index is built documents, depends strictly on the algorithm used by the search for such indexing. The indexing formula, ie the indexing algorithm, is usually one of the best kept secrets of the web. Anyone who knows exactly how it works, you can obviously use that knowledge to manipulate search results. In fact, SEO specialists and enthusiasts in this, do your best bet as it works to apply these assumptions to optimize websites and web pages in order to obtain top positions in the results. And although the result of indexing is a largely automated process, eventually know that there is some human intervention on the side of the search engines to remove and delete sites that are abusing SEO techniques, or on the other hand, favoring certain sites by question mark or authority.

Similar Threads

  1. How fast does Google crawl and index pages
    By Aideen in forum Technology & Internet
    Replies: 4
    Last Post: 26-01-2011, 12:27 AM
  2. How many times in a month Google crawl the website?
    By Elizabeth%allen in forum Technology & Internet
    Replies: 5
    Last Post: 16-01-2011, 07:25 PM
  3. Does Google decides which content to index & what not to index?
    By Uddhav in forum Technology & Internet
    Replies: 5
    Last Post: 04-03-2010, 07:37 PM
  4. How to use onload audio to index pages
    By Solaris in forum Windows Software
    Replies: 3
    Last Post: 06-08-2009, 10:46 AM
  5. Google Webmaster Tool - Diagnosis Average Crawl Rate of Google Bots
    By blindsleeper in forum Software Development
    Replies: 1
    Last Post: 28-05-2009, 11:02 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Page generated in 1,714,031,797.72027 seconds with 16 queries