SEO – Sitemaps and the Robots.txt

This weekend I have been working a lot with sitemaps and the infamous robots.txt file. I have been trying to increase the SEO I am doing on my site as well as my client’s sites. A great little app that will automatically build your sitemap and upload it via FTP is called GSiteCrawler. This free piece of software will save you a lot of time from building a sitemap file yourself.

Gsitecrawler Application - Sitemaps

Also, if you have a website and are trying to increase your search engine ranking, there are another two things you need to do. First, you need to create a robots.txt file so that search engines can crawl your site. A general robots.txt file which allows a search engine to crawl through everything would look like this:

User-Agent: *
Allow: /

Some handy tools for this are Google’s Webmaster Tools.
And of course, you will want to submit your site to search engines. This combined with the crawling .txt are bound to increase your rankings and traffic. Some good sites for this are and

You may also like:

Check Username Availability at Social Networking S... Ever helping someone promote a business, or perhaps you are starting a new brand name and want to check all the available social media usernames? Ther...
Best WordPress Plugin for Checking Broken Links &#... If you are looking for a good WordPress plugin to find and fix broken links then Broken Link Checker is one you want to check out!
How to Manually Force Crawl Your Raven Tools Site We recently wrote an article on how to force crawl your Moz site. This is a short tutorial on how to force crawl your Raven Tools site. If you make a ... – The Figures of 2012 We thought it would be interesting to share our traffic statistics for 2012. We surpassed 500,000 unique visitors which was our goal! Here's shooting ...
How to Remove Your Site from Alexa Dashboard If you manage a lot of websites, you might want to do some cleanup on your Alexa dashboard. This is a short tutorial on how to remove a site from your...
READ ALSO  IE space between images
  • pen drives personalizados

    Considero que este este blog esta entre os mais interessantes para minha atividade. Tenho gostado navegar pelos novos artigos, sempre de excelente qualidade :D. Continuem assim!