robots txt for job roller
I see there is a need for heavy robots.txt to protect unwanted files from robots. Here is the robots.txt I am using. Of course some of these items are not for
WP but for html files.
User-agent: *
Disallow: /support
Disallow: /forgot
Disallow: /auth
Disallow: /personal
Disallow: /private
Disallow: /mycompany
Disallow: /planning
Disallow: /delaccount
Disallow: /logout
Disallow: /search
Disallow: /error
Disallow: /jobmail
Disallow:/bizlinks
Disallow:/images
Disallow:/login
Disallow:/
wp-content
User-agent: *
Disallow: /
wp-admin
Disallow: /
wp-includes
Disallow: /
wp-content/plugins
Disallow: /
wp-content/cache
Disallow: /
wp-content/themes
Disallow: /
wp-includes/
js
Disallow: /trackback
Disallow: /category/*/*
Disallow: */trackback
Disallow: /*?*
Disallow: /*?
Disallow: /*~*
Disallow: /*~
Disallow: /resumes
Does anyone see where I need to add or make changes?
Thanks, Roc1