cancel
Showing results for 
Search instead for 
Did you mean: 

Robot txt file best practices

Robot txt file best practices

Hello, there is a lot of different info out there on what this should be for magento 2. I found these two that seem to be the most 'common'. 

Do these look accurate or is there any info you could share on what this should be for our store? I read the dev docs and they are pretty vague (which I know is intentional) and we do have the defaults set.

 

Would anyone care to share what the robot txt file should be for magento 2?