Frequently import products through API

[ande85]

Hi,

I need som guidence on how I should approach my problem. We have a pretty big product catalog (around 160k products) and get updates from distributor several times a day.

My idea was to write a script that import the changes through the Bulk API.

That works pretty smooth but once the products imported they end up in queue which is really slow and seems to slow down the site.

Does anybody have any suggestions on how to solve my issue? Is there a better approach to frequently import a lot of products?

Thanks in advanced to your suggestions!

[toniagency82ed]

I guess you only run one consumer through default cron that starts it every minute?

You can run multiple consumers at the same time which will increase the speed at which the queue is being consumed.

[ande85]

Ok, is there any documentation on how to configure that? 

This is how my env.php looks like where I guess this is confiugured:

'cron_consumers_runner' => [

'cron_run' => true,

'max_messages' => 10000,

'consumers' => [

'async.operations.all'

]

],

[toniagency82ed · Accepted solution]

The's just one of the ways to run consumers, the default one that triggers by cron every minute. 

The topic is a bit more complex than that, and the best I can do is point you to read this - https://magento.stackexchange.com/questions/366274/does-magento-2-launch-all-rabbitmq-consumers-only...

[myobessent585a]

Frequently importing products through an API can be a great way to automate your inventory management and keep your product listings updated. However, to give you specific advice, I need more information about your situation. Here are some questions that will help me understand your needs better: Raising Cane’s Menu Prices