Gatsby build halts due to high number of pages
Budget: $30 – $250 USD
Our site is generated with Gatsby using content coming from Sanity.
On the live site we have a total of ~24K pages that are built using roughly the same number of sanity documents. The Sanity dataset contains a total of ~30k documents (not all of them are directly used for the site building), its overall size is ~2.1 GB.
We plan to scale up our site to have 20-50x more pages, but we see serious problems already. Recently we attempted to add ~7K new pages (using a similar number of new sanity documents) and our build just stopped working. It halts in the createPages phase while querying the data nodes using graphql.
We studied the documentation and did many experiments to figure out what’s broken and to find a proper fix but so far all of our attempts have failed.
In the production system we use Gatsby version 2.32.13, during our experiments we tried the latest (4.12.1) version of Gatsby and all of the plugins we use - there were some small improvements, but eventually the build still failed in all of our trials.
We would like to get help with diagnosing our current problem and finding a solution
On the live site we have a total of ~24K pages that are built using roughly the same number of sanity documents. The Sanity dataset contains a total of ~30k documents (not all of them are directly used for the site building), its overall size is ~2.1 GB.
We plan to scale up our site to have 20-50x more pages, but we see serious problems already. Recently we attempted to add ~7K new pages (using a similar number of new sanity documents) and our build just stopped working. It halts in the createPages phase while querying the data nodes using graphql.
We studied the documentation and did many experiments to figure out what’s broken and to find a proper fix but so far all of our attempts have failed.
In the production system we use Gatsby version 2.32.13, during our experiments we tried the latest (4.12.1) version of Gatsby and all of the plugins we use - there were some small improvements, but eventually the build still failed in all of our trials.
We would like to get help with diagnosing our current problem and finding a solution
Related categories:
GatsbyJS