Topics to Be Covered in This Course (Cont.)

---

A World Wide Web Search Engine
The first two programming exercises are related to the construction of a web search engine, which includes the following three components:

• Traversal crawlers,
• Indexing software, and
• Search and ranking software.

Traversal crawlers: A crawler is software that automatically scans various web sites and collects web documents from them. They follow the links on a site to find other relevant pages. Depth/breadth -first search method is usually used for the web page traversal.

• Indexing software: Automatic indexing is the process of algorithmically examining information items to build a data structure that can be quickly searched.


• Search and ranking software: This software analyzes a query and compares it to the indexes to find and determine in which order to display the relevant pages.

Review: A World Wide Web Search Engine

Which is NOT one of the major components of a traditional web search engine?   Data mining software   Indexing software   Search and ranking software   Traversal crawlers

Result: