I may changing the categories for products in my site in an attempt remove duplicate content issues and allow easier bot crawling.
so for example
Products which are in category
will now only appear in d
my question is do I really need to do 301 redirects if magento can already do:
The page you requested was not found, but we have searched for relevant content
If I don't do 301 when the spiders hits root/product1.html and can't find it, how reliably will it find root/d/product1.html if it does find root/d/product1.html the spider should then index this page instead correct?
I have turned off category paths in the backend, so all my url's are going to the root
but I do intend on turning this on again when I make the change
Why you won't use canonical URLs for your products?
I was talking with some SEO professionals just to get another point of view.
The recomendation (in my case) was to use cannonical URLs.
I guess it will depend (a little bit) of which person manage your marketing strategy but, in my case, as developer, my decision will be to use the cannoncial option.
I suggest the same way to use the Canonical URLs for letting Google know which page should be displayed for the relevant searches as @Damian Culotta mentioned.
I'm doing using this method for the last 6-7 years and never had any issues in crawling or getting the pages displayed in Search pages.
You don't need to do the redirections. Canonical URLs are meant to be for such duplicate pages.
Let me know if this answers your question.
I've been getting so many answers from different sources, to be honest I'm not sure what to think anymore!
I'll need a long hard think about this and get as many opinions as possible then I guess I'll just have to trust someone is right and someone is wrong #meltedbrain
I undertstand you perfectly.
You should find a partner/consultant who inspires you trust and work from there.
In the meantime maybe would like to take a final moment to read why canonical urls are a good thing: https://support.google.com/webmasters/answer/139066?hl=en
I have another question on a similar vine,
As mentioned above I have turned off category paths for my products so all product url's are:
Google has been crawling these pages for 6+ months now
If I turn on category paths again, will Magento automatically redirect Google and users from:
so allowing Google to Index the full path?
Basically I'm trying to see if I need to do 301 redirects/Cano tags on my thousands of products