Hello, this post gives you all Robots.txt
Disallow:
Disallow: /
Disallow: /folder/
Disallow: /file.html
Allow Everything
User-agent: *Disallow:
Block Everything
User-agent: *Disallow: /
Block A Folder
User-agent: *Disallow: /folder/
Block A File
User-agent: *Disallow: /file.html
What a great post that you have shared here. You make information effortless for us that we get good facts about it. Thanks for this informative blog. WordPress robots.txt file
ReplyDelete