Blocked By Robots

[mark_williams1]

I have almost 19,000 products (grouped and simple) in my store.

Looking at my Google Search Console, 138 pages are being indexed but 10,998 are being blocked by robots!

Below is my robots file.  Is something in there that shouldn't be?  Is something else causing this?  Or is this normal for a Magento store?

[Damian Culotta]

Hi @mark_williams1,

This sample could be a good starting point: https://gist.github.com/petskratt/016c9dbf159a81b9d6aa

Also, maybe you can evalute for qualified support in this area since is something you will need to improve and change from time to time in order to get better results. Isn't just a "one-time" thing.

[gelanivishal]

Hello @mark_williams1,

Your robots.txt is fine. Have you checked your sitemap.xml file? Are you getting same product count as indexed by google? If not then please resubmit on google search console. May be your issue will be resolved.

If you have any trouble then let us know.
--
If you've found one of my answers useful, please give "Kudos" or "Accept as Solution"