Originally, website owners submitted the deal with of a website page, or URL to the various search engines like yahoo, which would mail a web crawler to crawl that site, extract inbound links to other pages from it, and return data found on the webpage for being indexed.[5] Regular Updates: https://www.youtube.com/watch?v=3GHWK6QaT2M