Efficient Elasticsearch Product Retrieval and Shopify Status Handling in n8n

Job ID: 38591167

Budget: $10 – $30 USD

I need help optimizing the retrieval of a large number of products from Elasticsearch and implementing product status management for Shopify integration, all within n8n.

Key requirements:

Fetching products from Elasticsearch in n8n:

Currently, I can retrieve up to 10,000 products per request, but I need to fetch approximately 185,000 products efficiently.
The current setup where I retrieve 30,000 products takes about 10 seconds to load, which is too slow. I need a solution within n8n that can handle the large volume of products without compromising performance.
Handling product statuses in n8n:

Implement a function in n8n to manage product statuses: "Sent," "Not Sent," and "Pending." These statuses will determine whether a product should be sent to Shopify or not.
Optimized page loading in n8n:

The solution should avoid multiple HTTP requests (e.g., 19 requests to retrieve 185,000 products), as this would significantly degrade performance.
I am looking for an efficient and scalable solution that can be implemented in n8n to retrieve all products and manage their status without negatively affecting performance.
Related categories: JavaScript HTML Elasticsearch