ImportExport: performance problem with multi store setup, inventory item reindex

[apiuser]

Feature request from paales, posted on GitHub Jul 29, 2016

Preconditions

1. Magento 2.1.0

Steps to reproduce

1. Setup 50 stores, with 50 seperate root categories with each their own subcategories.
2. Import products using the importer, 200 should be enough

Expected result

1. It does a little bit less than 14000 queries for 200 products

Actual result

1. [Screenshot, logs]

[apiuser]

Comment from mrkhoa99, posted on GitHub Jul 29, 2016

Hello @paales , I'm interesting in your tool? Which tool you use to check the performance?

[apiuser]

Comment from paales, posted on GitHub Jul 29, 2016

@MrKhoa99 We're using https://blackfire.io/, works pretty great

[apiuser]

Comment from paales, posted on GitHub Aug 04, 2016

I guess the indexer should triggered somewhere else: https://github.com/magento/magento2/blob/develop/app/code/Magento/CatalogImportExport/Model/Import/P...

As a matter of fact, I believe this handled by the cataloginventory_stock_cl if I'm not mistaken.

[apiuser]

Comment from paales, posted on GitHub Aug 04, 2016

I think it doesn't have to do with the multiple stores, it is just that the indexer is triggered for each bunch. Shouldn't happen inside the importer, the indexing should happen afterwards or just by the indexer cron

[apiuser]

Comment from paales, posted on GitHub Aug 09, 2016

It seems I had the indexers set to On Save. Although the performance shouldn't be as bad with On Save, I have to investigate further if this problem occurs when the stock items are actually updated On Schedule