Thread: question about robot.txt

question about robot.txt

Hi,

You provide a robot.txt file to use if we want to prevent robots from indexing jobseekers uploaded files. That's a great thing.

However, I just want to be sure it won't prevent robots from indexing the whole website when you write a line like this one :

Since the jobroller theme (and all the content, blog posts, etc, I suppose) are in the wp-content folder, if we disallow this folder in the robots file wouldn't it prevent robots from indexing it??