Google Search problem

[antrax13]

Hi,

I have a problem in Goolgle search, I have many urls of this type:

https://xxxxxxxx.x/es/stores/store/redirect/___store/en/___from_store/es/uenc/aHR0cHM6Ly9sb2xhdG95cy...
https://xxxxxxxx.x/es/stores/store/redirect/___store/pt/___from_store/es/uenc/aHR0cHM6Ly9sb2xhdG95cy5jb20vcHQv/
https://xxxxxxxx.x/es/customer/account/login/referer/aHR0cHM6Ly9sb2xhdG95cy5jb20vZXMv/

To solve this I add this lines to robots.txt

Disallow: /stores/store/redirect/___store/en/___from_store/
Disallow: /stores/store/redirect/___store/pt/___from_store/
Disallow: /customer/account/login/

is it correct?

Regards!!

[johnwebdes40a5]

Hello @antrax13 ,

You're on the right track by using robots.txt to prevent search engines from indexing those URLs, but there are a few things to clarify:

Generalize the Redirect URLs: Instead of hardcoding language en, pt, etc. in the robots.txt rules, you can use a wildcard (*) to block all redirects. This way, if there are more languages or changes in the redirect pattern, they will be blocked too.

Disallow: /stores/store/redirect/___store/*
Disallow: /customer/account/login/

The * wildcard will match any characters after /___store/, preventing any language-based redirects from being indexed.

Hope it helps ! 

If you find our reply helpful, please give us kudos.

A Leading Magento Development Agency That Delivers Powerful Results, Innovation, and Secure Digital Transformation.

WebDesk Solution Support Team

Get a Free Quote | | Adobe Commerce Partner | Hire Us | Call Us 877.536.3789

[tatetopggg93cb]

Your approach to disallow certain URLs in your robots.txt file is generally correct. However, while robots.txt prevents compliant search engines from crawling specified paths, it doesn’t guarantee that these URLs won’t appear in search results. For more control over indexing, you might consider using the noindex meta tag on these pages. Additionally, if you're concerned about Google's translation features affecting your site's appearance in search results, you can use the notranslate meta tag: <meta name="googlebot" content="notranslate">. This prevents Google from offering a translation of the page in search results.