How Do Search Engines Work - Web Crawlers
It is the search engine that finally put your website to the attention of potential customers. Therefore, it is best to know how these search engines actually work and how to present information to customers to initiate a search.
There are basically two types of search engines. The first is by robots called crawlers or spiders.
Search engines use spiders to index websites. When you send your web pages search engine to complete their required submission page, the search engine spiders index your site. A "spider" is an automated program that is managed by the system's search engine. Spider visits a web site to read the page content, meta tags of the site and follow the links that the site connects. The spider returns all that information to a central repository where data are indexed. We will visit each link you have on your website and index those sites as well. Some spiders only index a certain number of pages in your site, so do not create a site with 500 pages!
The spider periodically on site to verify any information that has changed. The frequency with which this occurs is determined by the moderators of the search engines.
Spider is almost like a book that contains a table of contents, actual content and links and references to all the sites located during the search, and can crawl up to a million pages a day.
Example: Excite, Lycos, AltaVista and Google.
When you ask a search engine to locate information actually is to search the index created and not actually searching the Internet. Different search engines produce different rankings because not every search engine uses the same search algorithm indexes.
One of the things the search engine algorithm scans for the frequency and location of keywords on a web page, but it can also detect artificial keyword stuffing or spamdexing. Algorithms then analyze how the pages of links to other pages on the Internet. By checking how pages link to each other, an engine at a time to determine what a page is about, if the keywords of the linked pages are similar to keywords on the page.
There are basically two types of search engines. The first is by robots called crawlers or spiders.
Search engines use spiders to index websites. When you send your web pages search engine to complete their required submission page, the search engine spiders index your site. A "spider" is an automated program that is managed by the system's search engine. Spider visits a web site to read the page content, meta tags of the site and follow the links that the site connects. The spider returns all that information to a central repository where data are indexed. We will visit each link you have on your website and index those sites as well. Some spiders only index a certain number of pages in your site, so do not create a site with 500 pages!
The spider periodically on site to verify any information that has changed. The frequency with which this occurs is determined by the moderators of the search engines.
Spider is almost like a book that contains a table of contents, actual content and links and references to all the sites located during the search, and can crawl up to a million pages a day.
Example: Excite, Lycos, AltaVista and Google.
When you ask a search engine to locate information actually is to search the index created and not actually searching the Internet. Different search engines produce different rankings because not every search engine uses the same search algorithm indexes.
One of the things the search engine algorithm scans for the frequency and location of keywords on a web page, but it can also detect artificial keyword stuffing or spamdexing. Algorithms then analyze how the pages of links to other pages on the Internet. By checking how pages link to each other, an engine at a time to determine what a page is about, if the keywords of the linked pages are similar to keywords on the page.
