Create Product Attribute Error Timeout

[ueksi533gma0ad]

We have a website that sells jewelry, and on this website, we have approximately 20,000 products. For each product, there are approximately 10,000 variants, such as:

Color: Blue, Black, Red, Pink, Purple

Size: S, M, L, XL, XS

Number: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30

When we try to create about 10,000 variants for one product as a customizable option, we encounter a timeout error.

To overcome this issue, what should we do?

Additionally, we have considered the following: We can open customizable options within the product, allowing users to make selections. However, when we add customizable options for one product, we still need to do it individually for other products. How can we do this more efficiently?

[mehmettalib454]

I have been experiencing the same problem for a long time. I sell jewelry with gemstone variations, and one of my products has 17,000 variants. No matter what I do, I can't upload the product.

[muhammadfa5b0d]

To overcome timeout errors and manage product variants more efficiently:

1. Create variants in smaller batches.
2. Use automation or scripts.
3. Prioritize popular variants.
4. Simplify options when possible.
5. Explore dynamic product options.
6. Optimize server resources.
7. Seek professional assistance if needed.

[toniagency82ed]

10 000 variants is A LOT. Are you creating custom options on a simple product or a configurable product with simple products as variants? 

Have you tried increasing your max_input_time, max_input_vars and post_max_size settings of your server (in php.ini)?

[sukas]

We create products as configurable product. Then we add other features of the product by saying create configuration below. This creates thousands of products in magento. We want to add options like enamel color, mineral color and size of a product. We increased max_input_time, max_input_vars and post_max_size values on the server. Although these helped us reduce processing times and speed up, they did not completely solve the timeout problem. I don't have a problem with the magento system I installed locally. By the way, the maximum number of products we see when adding variants is 16000.   We also use nginx server on debian 11. Dns is routed through cloudflare. We still haven't solved the problem completely. 

[toniagency82ed]

Oh you're making configurable products, not just custom options on a simple product... The thing is 20k products * 10k variants is really close to the recommended limit of effective SKUs you can have for Magento 2. - https://support.magento.com/hc/en-us/articles/360045066791-Product-limits-best-practice

If you have multiple websites or multiple customer groups that ads another multiplier to this number. 

It's not impossible to run even 10x or 100x what you're attempting to do, but that will require some serious optimization on the code and infrastructure level to make it work.

[Milople]

Hi @ueksi533gma0ad,

Managing a large number of product variants in Magento can be challenging, especially when dealing with thousands of products and options. To overcome the timeout issue and efficiently handle customizable options, consider the following strategies:

1. Use Configurable Products:

Magento offers the concept of configurable products to handle product variants more efficiently. Instead of creating all possible combinations as customizable options, use configurable products to represent different attributes like color, size, and number.

This approach has several benefits:

• Better Performance: Configurable products are more efficient and perform better than having a massive number of customizable options.
• User-Friendly: It provides a better user experience by allowing customers to select options like color, size, and number from drop-down lists.

2. Configurable Products with Custom Options:

Combine configurable products with custom options. Configurable products handle variations like color and size, while custom options can handle additional specifications that apply to all variants of a product.

For example:

• Configurable Product: T-shirt with options for color and size.
• Custom Options: Additional specifications like engraving, gift wrapping, or any other unique options applicable to all T-shirt variants.

3. Magento Batch API:

Use the Magento Batch API to create configurable products and associated variants in batches. This can help you avoid timeout issues when dealing with a large number of products.

4. Magento Index Management:

Regularly reindex your Magento store after making changes. This ensures that the product data is properly indexed and improves the performance of your store.

5. Optimize Server Performance:

Ensure that your server has sufficient resources to handle the processing of a large number of products. Consider optimizing your server configuration, including PHP settings and MySQL configuration.

6. Third-Party Extensions:

Explore third-party extensions that specialize in handling large product catalogs. Some extensions are designed to improve the performance of configurable products and manage large datasets efficiently.

7. Data Import/Export:

Consider using Magento's built-in data import/export functionality to update product data efficiently. You can prepare a CSV file with the required information and import it into Magento.

8. Database Cleanup:

Regularly clean up unnecessary data from your Magento database, such as logs, old orders, and unused attributes. This can help improve overall database performance.

9. Magento Profiling and Optimization:

Utilize Magento profiling tools to identify performance bottlenecks and optimize code accordingly. This may involve working with a Magento developer to analyze and improve the efficiency of your customizations.

10. Caching Strategies:

Implement and optimize caching strategies to reduce the load on your server and improve the response time for product pages.

By adopting a combination of these strategies, you should be able to efficiently manage a large number of product variants in your Magento store. Always perform these operations on a staging environment first, and make sure to have a backup of your data before making significant changes in a live environment.

In Magento, there is also a limit on how many product attributes you can have if the limit increases then that will give you a timeout issue so you have to reduce some of the attributes you can find out cart limits, catalog limits, product attributes here:

https://experienceleague.adobe.com/docs/commerce-operations/implementation-playbook/best-practices/p...

If the issue will be resolved, Click Kudos & Accept as a Solution.

[snapapkpro552f]

I’ve dealt with similar issues before, and managing large product variations in Magento can be tricky. Breaking down variants into smaller batches and using automation definitely helps. Also, optimizing your server settings and database can reduce timeouts. I ran into this while working on my own site, https://snapapkpro.com and had to find ways to streamline things. Hope this helps!