For the Love of Robots.txt

Top 5 reasons for bots to avoid your site like the plague!
clipped from www.free-seo-news.com
Reason 1: Your robots.txt file is damaged or it contains a typo
Reason 2: Your URLs contain too many variables
Reason 3: You use session IDs in your URLs
Reason 4: Your web pages contain too much code
Reason 5: Your website navigation causes problems
  blog it

Leave a Reply