Hello all! Hopefully this issue will sound familiar to someone, because trying to find a solution through Google has proved fruitless.
Recently we discovered that a "test" version of our site was still active, and that people could purchase products from this test site. We have no idea how to deactivate it, and any attempts to disable or make changes to the test site under the "Design" tab affects the main site we are using right now.
Main site: http://www.blinkoptic.com
Test Site: http://www.blinkoptic.com/test/
Google search results only return articles for how to turn the test site message on and off. Obviously we don't care about turning the message on or off, we just need to know how to get rid of the test site.
Please help!
/modne-fryzury-meskie-co-teraz-sie-nosi/
Add to robots.txt file Disallow: / test /
There are following ways you can prevent search engines to crawl or index your test or staging Magento site
1) Add the following entry in robots.txt and upload this file on root of your test or staging sites
This robots.txt is respected by all search engines and by adding the above entry you are telling them that don’t crawl any URL of this website.
2) Set NO INDEX, NO FOLLOW for all of Magento URLs
Step 1 – Login to your Magento Admin
Step 2 – Go to System -> Configuration -> General -> Design -> HTML Head -> Default Robots -> NOINDEX, NOFOLLOW
Step 3 – Go to System -> Cache Management -> Refresh Cache
Please make sure you don’t apply any of the above prevention methods on your live site
The above will help you to prevent your staging site to appear in Google but what if you forgot to put any of the above prevention at the first place. And Google and other search engines have crawled and indexed your staging or development sites.
The most easiest way to remove your staging site from search engines is to add any of the above preventions and request Google to remove your staging site.
To remove your already indexed site from Google search engine pages you need to follow the following steps -:
Step 1 Create your staging site in Google webmaster tool
Step 2 Get your staging site verified
Step 3 Once the verification is done then click on your staging site in Google webmaster tool
Step 4 Select Google Index -> Remove URLs from left hand navigation
Step 5 Click “Create a new removal request” button
Step 6 Enter “/” in the URL text box provided
The above will create “Site removal” entry for Google to remove your site from search result pages. It generally takes 24 hours for Google to remove all your staging site links from search results.
Please kudos, if article help you. Cheers coding!