July 5th, 2008How a search engine works
Spider:
A spider is a robotic program that downloads web pages and looks at the code of the page. The spider doesn’t have any visual components at all, if you right click on most web pages and go to view source that is what the spider can see.
Crawler:
While the spider is downloading pages, it is the [...]
Read more...




