Fun with robots.txt
Columnist Patrick Stox provides some dos and don’ts for creating your robots.txt file — along with examples of companies who have gotten creative with their files.
The post Fun with robots.txt appeared first on Search Engine Land.
Please visit Search Engine Land for the full article.