Home > Tips > Robots.txt: Allow Directive

Robots.txt: Allow Directive

October 7th, 2009 Dan Leave a comment Go to comments

Just a quick tip for writing a robots.txt file for your website, especially if you’re using the Google Webmaster Tools website to help you; the allow: /directory-name/ directive is not part of the standard protocol.

It’s definitely supported by Google but I’m not sure about other search engines.

VN:F [1.9.1_1087]
Rating: 0 (from 0 votes)
  • Share/Bookmark
Categories: Tips Tags: ,
  1. No comments yet.
  1. No trackbacks yet.