Magento 2.4.1 categories product disappear automatically

[prince_ramgarhi]

I am facing this problem since I update to the latest Magento 2.4.1 I have elastic search running but categories product disappear automatically and I have to run the reindex command this is happening 5,6 times in a day I have 3500 SKU on my website
it shows WE CAN'T FIND PRODUCTS MATCHING THE SELECTION.
after running reindex command it starts working again for sometime
kindly help

[kqt377]

I just came here to post about the same issue.  Currently running 2.3.6_p1 no issue.  Base install, not extensions.  After upgrade to 2.4.0/1 site runs fine for several hours, and then products cannot be found on category pages, and search also returns no results.  Cron is running (including indexing) successfully w/o errors. No errors in logs. Database checks pass. Scheduled indexing does not fix despite backend indicating the indexes are updating.  However, re-indexing the following via CLI fixes search and product pages, respectively:

php bin/magento indexer:reindex  catalogsearch_fulltext

php bin/magento indexer:reindex catalog_category_product

Please advise what might make CLI but not cron indexing work properly.

Thanks

[kqt377]

Adding that issue is present when running either php ea-7.3 or 7.4

[prince_ramgarhi]

I am running 3 sites in same server and all has same problem still no solution found 

[prince_ramgarhi · Accepted solution]

I have found a solution maybe it helps you 

I am running 3 sites in 1 AWS server and elastic search need the prefix for all sites so that I don't confuse with all sites 

here is a quick tip 

go to admin > Catalog > catalog > Catalog Search > Elasticsearch Index Prefix 

fill this column with your site name 
so all three different sites have different names and it works for me 

[kqt377]

Excellent.  This appears to have been my issue as well as I have a dev domain on the same server.  Added the site to the address as prefix and so far so good.  Thank you very much for posting the solution!

[kqt377]

So I’m having this problem again but only for new products (I’m finally adding some new new products since this original post ). The above solution worked for my existing products. Now when I add new ones they originally are visible in the correct categories, but disappear overnight. Reindexing solves temporarily but they disappear again overnight. Has anyone else had this remaining issue? Any suggestions? Thanks. 

[alex_lopez2]

Configure Cron

php bin/magento cron:install

php bin/magento cron:run

php bin/magento cron:run

*2 times