Here are a few points to consider (any input, comments, tips, notes, thoughts… gratefully received):
1. Homepage footers are bad news and may even carry penalties – solution: integrate the footer navigation into the content on pages.
2. Information architecture is key to a well indexed site — how do the pages flow and can page rank easily flow throughout your site? Think of it as a pyramid of champagne glasses being fed by a bottle pouring into the glass at the top of the pyramid; can Google get to all the pages?
3. Add RSS feeds to regularly changing content to make doubly sure it gets indexed.
4. The concept of crawl allowance. When Google spiders your site, it will have a certain amount of time or an allowance of pages that it spend in your site. The allowance will be driven by many factors including the quality of content; the better the content, the more likely Google will spend more effort trying to index the whole of your site. You may be lucky and have your whole site spidered and indexed; on the other hand, you may have only a fraction of your site indexed. Because Brownbook.net has 34 million business details pages, our challenge is how do we get the highest value pages indexed, in preference to the lower quality pages and therefore encourage Google to dig deeper.
5. Google MayDay update reportedly de-valued pages with little unique content.
6. Sitemap. Pay little attention to ‘crawl rank’ within the sitemap, as Google does not seem to take it in to account. Do not have any re-directed pages in the site map.
7. Separate TLDs (top level domains eg .com, .uk) for each country. A good ‘rule of thumb’ is that if you have a separate marketing department in that country, then yes, separate the site with its own TLD for that country. If you don’t, then stick with the one TLD and use sub directories for each country (eg www.brownbook.net/UK/xxxx) and channel all your marketing effort in to the one TLD. This way all marketing effort is contributing page rank to one TLD and the efforts are not split in to multiple TLD’s. Use Google Webmaster Tools to tell Google which directory is for which country.
8. Microformats. Use wherever possible and then test using Google’s rich snippet tester.
9. Google Analytics. Use the new asynchronous Analytics code to increase page load speed.
