Robots File | Digital Marketing Agency India

Robots File

Get Hand-picked Digital Marketing News Inboxed Weekly

 

Robots.txt

Category: On-site Value
Importance Level: 2/5
 
  • Do’s: Have the XML sitemap link and to block the unwanted pages from it. Do give a validation checks for different type of URLs.
  • Don’ts: Don’t go too crazy about it :)
TechShu Consultancy Pvt. Ltd
22-05-2013
5/5 stars
Techshu is doing very good work for me. I am continuing to use them for this ongoing project