Web crawler is a program which crawls around the web and pick all links they find in the process. Search engine like Google uses web crawler. Any new links (i.e. website and blogs) get listed in this way automatically. In another word, whenever crawler come to a particular website, it look for all possible links in the website and if your website link is there then crawler will index it in the database. This is the natural way. However if your site is new and you don’t have any links at other place then you can manually submit your URL to Search Engines.

Google: Submit your site’s URL at http://www.google.com/addurl/?continue=/addurl . However Google don’t guarantee you of listing of your website. Even if your site is listed there is no guarantee that all of your pages/articles will be listed. You can also use “sitemaps” to submit your site contents to Google. Sitemaps is the list of stuffs in your site. Submission of the sitemaps can be done through Google Webmaster Tools (http://www.google.com/webmasters/sitemaps/). It keeps Google up to date regarding your updated contents. Using this you can also analyze errors in your links (like broken and non-working links). You can also see different external links to your site. It also gives you idea of different search term people use in Google to come to your site. Also, it gives idea about how many times your site appears in Google searches while searching for particular keywords. However to access your traffic details you need to verify the ownership of the site at Google Webmaster Tools. You have to upload some file in your root directory to get it verified. It is very easy to do and don’t take more than 5 minutes. But in return you will get lots of traffic information for free.

Yahoo: Yahoo offer two types of listing – directory (organized by topic) and search results (keywords based). Listing in the Yahoo directory cost $299 per annum. It is good if you are sure that the incoming traffic will generate lots of revenue for you. For getting listed in the search results you can submit your site to http://search.yahoo.com/info/submit.html. However listing is not guaranteed. Higher number of links increases the chances of listing. Alternatively you can opt for payment for better chance in the listing for search result.

Source: Article first published in Blogger’s Magazine.