A Simple Technique That Gets A Brand New Website Indexed By Google Within 24 Hours
Here's a simple technique that will get any website - commercial or non-commercial -- indexed by Google within 24-48 hours.
Here's what you do:
Simply get blog or weblog to add a link to your site on their homepage.
A blog is typically a journal containing bits of news, information, and links to relevant websites that the author adds on a regular basis.
This technique works because Google LOVES blogs and makes an effort to crawl thousands of them on a very regular basis, like daily, or even several times a day.
So the trick is to get a blog that Google crawls regularly to add a direct link to your website. An added benefit is that blogs typically have a good PageRank as many websites link to them.
To find a blog simply search for it in your favorite search engine. Enter the keywords related to your site and include the keyword 'blog' or 'weblog' in the search query, and you should be presented with a bunch of relevant blogs.
To refine your search results, you could tell Google to only return results with the keywords in the title. To do this, simply add 'allintitle:' before your keywords in the search form.
allintitle: internet marketing blog
Some search engines, such as Google, will indicate the date the site was last crawled and indexed. Pick blogs that have been updated recently. Visit each one to make sure it is relevant to the topic of your website.
Some blogs welcome news submissions. Others don't openly say they welcome news, but you should find that most blog owners are happy to received news that they can add to their blog.
If you have something interesting to say about your new site, then write to the blog owner with your story. If you can't think of anything newsworthy, then offer to pay for a small text link on the blog owner's home page. If you can get the link added to every page; so much the better.
You could probably get a text link added for a nominal fee. Depending on the blog's popularity, I would expect to pay no more than $25-100 for a small text link ad for a one month period.
You may be wondering why you would want to have a link to your site on the blog site for one month if Google will index your site within 24-48 hours.
The reason is that Google does two types of crawls; a regular 'fresh crawl' which runs about once a day and a main 'deep crawl' which runs about once a month.
The fresh crawl only indexes the main pages of a site. You have to wait for the deep crawl for Google to crawl and index the rest of your site.
You could probably get away with getting into the fresh crawl database with a 2 day text link, and then hoping that Google to does a deep crawl from the URL it has indexed as a result of the link from the blog. But I would recommend that you keep the blog link for a full 30 day period just to be safe.
Two Other Ways To Getting Indexed By Google
There are actually two others methods to getting listed in Google. But only one is guaranteed and that can cost you $299, if your site is of a commercial nature.
1. Submit Your Site To Google
The first method is to submit your website via Google's free 'submit your site' form.
Just submit your home page and Google's crawler, Googlebot, will crawl the rest.
However, Google do not add all submitted URLs to their index, and there is no guarantee as to when, or if, your site will be indexed.
2. Submit Your Site To The Yahoo! Directory & The Open Directory Project Index
As far as I know, this is the only 100% guaranteed method of getting into the Google index because Google has agreements with Yahoo! and Netscape to include the sites indexed in their directories in the Google index. So submit your site to either, or both (recommended), of these directories.
For more information, visit Yahoo!'s How to Suggest Your Site page and the Open Directory Project's How to add a site to the Open Directory page.
Once your site is included in either of these directories, it will appear in the Google index in about 4 to 8 weeks. So now you have no excuse for not getting indexed by Google.
How To Stop Google Caching Your Website
As Google crawls and indexes webpages, it also stores them in its cache to retrieve for users as a back-up in case the webpages are not available. Users can view the cached version by choosing the "Cached" link on the search results page. If you don't want your content to be accessible through Google's cache, set the NOARCHIVE attribute in a Robots meta tag.
<META NAME="robots" CONTENT="noarchive">
This tag tells ALL robots not to archive the page. All robots will continue to index and follow links from the page, but will not present cached material to users. If you want to allow other robots to cache your content, but only prevent Google's robot (Googlebot) from doing so, use the following tag:
<META NAME="googlebot" CONTENT="noarchive">
The change will take effect the next time Google crawl the page containing the NOARCHIVE directive in a <META> tag. If you want this change to take effect sooner, you must contact Google and request immediate removal of the archived pages.
The NOARCHIVE attribute only instructs robots whether it can provide a cached copy of a webpage. To control whether the page is indexed or links on the page are followed, visit the 'What Is A Robots Meta Tag' section for more information.