Solved: Preventing crawlers such as Google indexing your d... - Page 2

Oliver_Ogg · 07-31-2015 02:12 AM

Hi,

I've had a look in the docs, and the menu structure on our Dev Portal, but I can't see a way of preventing Google from indexing our Dev Portal. We might well like this in the future, but our current dev portal is not yet ready for the public.

How can I control this? Am I missing a setting, or should I be editing content templates?

anilsr

Dear @Oliver.Ogg ,

You can achieve same using multiple ways.

Restrict access to site using htaccess locking mechanism. If you are on cloud , out of the box it's available in pantheon.
Using Robots.txt in your developer portal root, please find more about it here and here.
Edit robots.txt with below content...

User-agent: *

Disallow: /

Apigee Developer Portal is built on top of famous open source CMS Drupal. See similar question answered here.

Cheers,

Anil Sagar

View solution in original post

Preventing crawlers such as Google indexing your dev portal