Crawling is the process of fetching all the web pages linked to a web site. This task is performed by a software, called a crawler.Crawls are based on many factors such as PageRank, links to a page,and crawling constraints such as the number of parameters in a URL...