Common Search Engine Principles

Common search engine principles Tips

To know more about SEO you need to be aware of the architecture of search engines.

They all contain the following main components:

Spider - a browser-like program that downloads web pages.

Crawler – a program that automatically follows all of the links on each web page.

Indexer - a program that analyzes web pages downloaded by the spider and the crawler.

Database – storage for downloaded and processed pages.

Results engine – extracts search results from the database.

Web server – a server that is responsible for interaction between the user and other search engine components.

Specific implementations of search mechanisms may differ. For example, the Spider+Crawler+Indexer component group might be implemented as a single program that downloads web pages, analyzes them and then uses their links to find new resources. However, the components listed are inherent to all search engines and the seo principles are the same.

Spider: Spiders component is a program downloads web pages just like a web browser. Spider can understand HTML code of the page. You may already know that there is an option in standard web browsers to view source HTML code.

Crawler: Crawler components find all links on each page. Crawler task is to determine where the spider should go either by evaluating the links or according to a predefined list of addresses.

Indexer: Indexer component parses each page and analyzes the various elements, such as text, headers, structural or stylistic features, special HTML tags, etc.

Database: This is the storage area for the search engines to store the data for downloads and analyzes. Sometimes it is called the index of the search engine.

Results Engine: The results engine ranks pages. Results Engine determines which pages best match a user's query or keywords which is typed on search bar to get information and in what order the pages should be listed. This is done according to the ranking algorithms of the search engine. Results Engine follows that page rank is a more valuable and any seo specialist is most interested in it when trying to improve his site search results.

Web server: The web server usually contains a HTML page and also responsible for displaying search results to the user in the form of an HTML page.