Website Creation



(Originally written for Create-Income-Generating-Website)

Search engines such as Google and Yahoo do not typically index all the pages of a website.  Even those that initially get indexed stand a change of getting dropped over time.  In theory, they select pages that make a significant contribution to information already available on the web.  The pages that actually get indexed may not seem logical.  Fortunately, there are things that you can do to increase the chances that the most important pages of your website are indexed. I will cover a dozen of them.

1.      Original & Useful Content - The most important thing that you can do is develop original and useful content.  Try to provide your potential site visitors with what they are looking for when they do a search using your main key word phrases.  Think of other related things that they will need to complete their effort and provide them that little extra, e.g. capabilities to search for campgrounds, access to maps, free stuff, etc.  It is important that your page content adds to the wealth of information and services that already exists.  It should be both attractive to site visitors and desirable by search engines.  Since search engines are looking for pages that make a significant contribution, it is a good idea to write your own page content keeping the interests of potential site visitors in mind and don’t just copy or paraphrase information already available on the web.  Using mostly content from various on-line sources may not only reduce your chances of getting the page indexed but can also reduce the page ranking should it get indexed, if that information has already been used by other webmasters.

2.      High Quality & Significant Content - The amount of original content on a page can impact whether it remains indexed by a search engine.  When it comes to content, a lot is better than little.  A short paragraph on a page may not be adequate.  If a page has a small amount of content, it is considered to be of less importance than one with a lot assuming equal quality.  Poor quality content can also prevent a page from being indexed.  It should read well and be free of misspelled words and grammar errors.  The web crawler is literate and can detect poor quality content.

3.      Structure & Indexes - The structure of a website can cause problems for the web crawler, preventing pages from being indexed.  It is best to use a logical structure that allows one to get to every page through a series of links starting at the home page.  You don’t want to jump around too much or have any unconnected pages.  Indexes should be straight forward and easy to transverse.  Sub-pages may be considered of less importance than main pages in an index.  Limit the use of fancy features using JavaScript and Flash since they can make it difficult for the web crawler to crawl your site.  If you want to test crawl your site, you can do it with a test browser, e.g. Lynx.

4.      Reliable Hosting Service – The website hosting service that you choose needs to be reliable.  You don’t want your host server to be down when the web crawler is trying to crawl your site.  Some free hosting services do not have a high server up time and may prevent your site from loading fast.  Use of these free hosts or any paid unreliable hosts may cause fewer pages to get indexed.

5.      Link Pages – Any page devoted to a random list of links is not likely to get indexed.  If you want all your links on one page, it is best to organize them by categories that contribute to the overall goal of your site.  Links that are not related to your website topic can give the impression that you are participating in link exchange just to manipulate page rank.  You may want to consider making the page a resource page containing text with the links to websites being just one type of resource. Link farms, buying links or excessive link exchange are not advisable.  The web crawler is smart and wise to these tricks.  If you do some link exchange, you should limit it to quality websites that compliment your site.   There are free tools, e.g., which can be used to check the page rank of other sites.  The best way to get links is to provide needed information and/or offer great services so other webmasters will want to link to your site to provide better support to their customers.

6.      No Sneaky Redirects - The use of sneaky redirects is in violation of Google’s Webmaster Guidelines.  This is where JavaScript is used to deceive search engines by placing different text in JavaScript than in a noscript tag.  Since links in JavaScript are hidden form the search engine, a redirect link is placed in JavaScript causing the search engine to index the original page rather than following the link but site visitors are taken to the redirected target.  If this deceptive practice is detected, it can prevent the site and/or page from being indexed.

7.      No Doorway Pages – Creating doorway pages is also in violation of Google’s Webmaster Guidelines.  This is where pages are written primarily for search engine and not people.  They are written to get a high ranking by search engines for a particular key word phrase by optimizing it for that specific keyword phrase.  Once a person arrives at that page they are funneled to another destination.  If this practice is detected, it can prevent the page from being indexed.

8.      Avoid hidden Text & Links – Use of text and links that are intended to be crawled by search engines but that are unreadable to humans may be perceived as deceptive.  They can be hidden by making them the same color as the background, placing them behind images, etc.  If this deceptive practice is detected, it can prevent the site and/or page from being indexed.

9.      Minimize Duplicate Content – It is best to have very little duplicate content among pages of your website.  If the web crawler detects a page title that is very similar to another one or page content that is repeated from another page, it may consider the page to be too much of a duplication and not index the page.

10. Irrelevant Words & Phrases - Avoid using key words in the content just to get a higher ranking for the page.  It is one thing to say something one way versus another in order to use a key word but keep in mind that you are writing for people and not web crawlers.  The text needs to read well and not be awkward because you inserted a key word phrase.  You certainly don’t want to load down a page with a lot of irrelevant key words.  The web crawler is smart and can detect this trick resulting in the page not being indexed or a low ranking.

11. Inbound & Internal Links – Links to your website pages from other quality sites increase the chances that your site pages will remain indexed by search engines.  If no other sites link to your website after several months of being up and running, search engines may consider your site to not contribute that much to the overall knowledge base in the subject area.  As a result, they may drop some pages from their index.  Again, the best way to get links to your site is to provide value added to your website visitors in the form of great information and services so other webmasters will want to link to your site to improve support to their customers.  You can check to see how many inbound links that you have to your website with Backlink Watch.  You can also use internal links to improve your chances of getting a page indexed.  For example, if an important page is not being indexed, you may want to write an additional good quality rich content article or document, upload it and link to it from your non-indexed page.  Also, include a link on the document back to the page. This does a couple of things to improve the situation.   If the document gets indexed, it may bring additional visitors to your site.  It should also increase the perceived value of the previously non-indexed webpage.

12. Submit Sitemap – Don’t underestimate the value of a sitemap in getting your website pages indexed.  A site map tells the web crawler how may pages you have and their relative importance.  A sitemap can be easily created using Google’s Sitemap Generator and Editor.  Submitting a sitemap to Google may result in your site being crawled within hours.  The same sitemap can be submitted to other search engines.  Most likely all your pages will not get indexed but it does seem to have some influence on which ones are indexed.  When you make significant changes such as adding pages and rewriting the content of pages, you should develop a new sitemap and replace the old one in your website root directory.


      Return to Articles & News                  Return to Website Home Page