- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2017
07:37 AM
04-19-2017
07:37 AM
Prevent Search engines from indexing sitemap file
Hello,
How do we prevent search engines from indexing our XML sitemap file?
Any ideias?
Thanks!
Labels:
4 REPLIES 4
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-20-2017
01:44 AM
04-20-2017
01:44 AM
Re: Prevent Search engines from indexing sitemap file
Hey @UNLda
You can use the following tag to achieve that:
X-Robots-Tag: noindex
Was my answer helpful? You can accept it as a solution.
230+ professional extensions for M1 & M2 with free lifetime updates!
230+ professional extensions for M1 & M2 with free lifetime updates!
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-27-2017
02:05 AM
04-27-2017
02:05 AM
Re: Prevent Search engines from indexing sitemap file
Could we add <META NAME="robots" CONTENT="noindex"> on a XML file?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-29-2017
12:59 PM
04-29-2017
12:59 PM
Re: Prevent Search engines from indexing sitemap file
Hi
I think you can add in robots.txt
Disallow: /sitemap.xml
Can you tell us why you want to prevent sitemap indexing ? Does it show up in search engine results ?
Maxime Coudreuse, developer of Product Manager for Magento: User-friendly product editor with customizable grid interface and category tree for Magento 1 and 2
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-28-2024
03:48 AM
10-28-2024
03:48 AM
Re: Prevent Search engines from indexing sitemap file
To prevent search engines from indexing your sitemap file, you can use the robots.txt file to disallow it. Here’s how you can do it:
- Update robots.txt File: Add the following line to your robots.txt file:
User-agent: *
Disallow: /sitemap.xml
This tells search engines not to crawl or index the sitemap file located at /sitemap.xml.
- Noindex HTTP Header (Advanced Option): Some web servers allow you to set a X-Robots-Tag HTTP header on the sitemap file, which instructs search engines not to index it. If you have access to server configurations, you can add:
Header set X-Robots-Tag "noindex"
in your server configuration (e.g., .htaccess for Apache) to prevent indexing.
- Ensure Proper Access Settings: Double-check that the sitemap is accessible to search engines for reading, as disallowing its crawling might prevent them from discovering your site’s content.