AWS doesnt't work magento 1.9.2.3 over 300,000 products! (AWS m4-xlarge)

[callme4989]

It doesn't work magento 1.9.2.3 over 300,000 products! Response being slow under a AWS m4-xlarge, region is Oregon. Very very slow to show up items after searching. To solve the problem, how should I do? Community edition does not accept over 100,000 items or ? Please let me know! (We are using AWS Web and DB server m4-xlarge.)

[JLHC]

Magento Community Edition can definitely run a store with 300,000 products smoothly provided that everything is setup properly. 

What is your server's CPU and Memory usage like? 

If they are able to keep up but the performance is slow, this can most likely be solved with proper software setup and optimization. 

Do you have any sort of caching system in place? That should help with performance as well. 

[callme4989]

Hello JLHC

I really appreciate your advice and kinds.

Actually we are using below web server and db server.

At the moment, Category search performance is so slow ...

And also we are using Magmi for insert 300,000 items(Magento Mass Importer).
http://wiki.magmi.org/index.php?title=Main_Page

How should I optimize? Thank you so much. 

From callem4989

-----

Web Server AWS(Oregon) EC2 m4.xlarge
CPU : 4core
*2.3 GHz Intel Xeon® E5-2686 v4 (Broadwell) or 2.4 GHz Intel Xeon® E5-2676 v3 (Haswell)
Memory : 16G
Strage : 30G
OS : Amzon Linux 64bit
PHP : 5.6.26
Cache : System APC(2,048M)

Db Server AWS(Oregon) RDS m4.xlarge
CPU : 4core
*2.3 GHz Intel Xeon® E5-2686 v4 (Broadwell) or 2.4 GHz Intel Xeon® E5-2676 v3 (Haswell)
Memory : 16G
Strage : 100G

[michel_wiel]

Hello @callme4989

I have excellent experience with https://www.hypernode.com/.

These are guys who know what they need to do to run a shop quickly without problems.

They also can setup a test account online set with your complete shop on it so you can test the speed.

best regards,

Michel

[Hadifarnoud]

I highly recommend you use Flynn (flynn.io) you can cluster medium EC2 nodes

[MagenX]

first you need to test your shop with Aoe Profiler

then run mysqltuner to check if your database properly configured and fits your server 

[AffiliNetCo]

Actually it does, some people know run that many products on a CE store in AWS. The problem is you need a cluster setup, otherwise it will fail. Can't give you the details, you'd have to speak with them directly, the alternative is Nexcess clusters but they are expensive.