Search Engine Spiders & robots.txt
So if I am wondering how to handle search visibility with robots / spiders such as Google & Bing...with Clipper you only have the index.php visible in the root /public_html/ folder so how does spidering get handled for all your stores and .php files within the subfolder /
wp/ where they are all located? Do you tell spiders to look within the Clipper wordpress folder /
wp/ too then to insure rankings?
Prior I was using standard .html files for each store, all within the root /public_html/ folder and spiders simply hit them and ranked them. Now I'm not sure how spiders will find each store, and all it's coupons within the stores to rank store pages as well as the homepage. I'd appreciate any wisdom here!
Assume the following:
- I have the theme files (Site URL) located within the /
wp/ subfolder within my main html public folder
- I have the Home settings address pointing to my root directory as desired /public_html/
Reply With Quote
You must be an AppThemes customer and logged in to view this response.