SEO – Sitemaps and the Robots.txt

This weekend I have been working a lot with sitemaps and the infamous robots.txt file. I have been trying to increase the SEO I am doing on my site as well as my client’s sites. A great little app that will automatically build your sitemap and upload it via FTP is called GSiteCrawler. This free piece of software will save you a lot of time from building a sitemap file yourself.

Gsitecrawler Application - Sitemaps

Also, if you have a website and are trying to increase your search engine ranking, there are another two things you need to do. First, you need to create a robots.txt file so that search engines can crawl your site. A general robots.txt file which allows a search engine to crawl through everything would look like this:

[vb]User-Agent: *
Allow: /[/vb]

Some handy tools for this are Google’s Webmaster Tools.
And of course, you will want to submit your site to search engines. This combined with the crawling .txt are bound to increase your rankings and traffic. Some good sites for this are and

You may also like:

Best WordPress Plugin for Checking Broken Links &#... If you are looking for a good WordPress plugin to find and fix broken links then Broken Link Checker is one you want to check out!
Check Username Availability at Social Networking S... Ever helping someone promote a business, or perhaps you are starting a new brand name and want to check all the available social media usernames? Ther...
11 Must Have WordPress Plugins This is a collection of 11 great WordPress plugins, all of which are used frequently on this blog. All of these plugins work on WordPress version 3.1 ...
How to Manually Force Crawl Your Moz Site If you ever you use Moz, you probably at some point will want to force crawl your site so that the statistics update. Especially if you just made a lo...
How to Manually Force Crawl Your Raven Tools Site We recently wrote an article on how to force crawl your Moz site. This is a short tutorial on how to force crawl your Raven Tools site. If you make a ...
READ ALSO  Clear Your Cache in Firefox 4.0
  • pen drives personalizados

    Considero que este este blog esta entre os mais interessantes para minha atividade. Tenho gostado navegar pelos novos artigos, sempre de excelente qualidade :D. Continuem assim!