build data driven website using streaming api and deployed in react/node.js
Budget: £18 – £36 GBP
Companies House UK offfer a stremaing api for all registered limited companies in the UK This is a freedom of information request api and is in various ormats. There is also a rest api which is pull rather than push (streaming).
I want a basic site creating in a fast and responsive format, such as react/node.js, possibly hosted on google cloud.
the site will tage the information from the api and create pages for each company.
There are over 14.5m companies registered over the years in the UK, and I would estimate that at least half of these are still active.
Because of the numbers involved, I think the streaming api is better, as they give out a data set initially to a set timepoint, at which the stream picks up.
The stream will also update existing records, which the rest api might not.
There are approximately 4000 new companies registered each week and each company will create a new page (or pages).
The stream is available in multiple formats and has around 4 different views, company, directors, financial submissions and an overview page. Logically these would be merged into one page.
This information is able to be used however we want, but it clearly needs to be ethical, which this is.
So, the summary is to deploy a database that wil generate pages for each business and adjust those pages according to the streaming dataset.
The deployment is for your choosing, as the expert, you should understand what is the most eficient method for this data task. The pages could be dynamic, but would need a sitemap being created so that they do exist somehwere in essence. There will also be a requirement to take a json feed to create a schema set for each page.
It should not really require daily manual input, especially if streaming is chosen over rest api.
I think that about covers it really. This is part one of a much bigger project, but I need to build out these steps to find the right working partner(s).
I look forward to hearing of prior experience and genuine understanding of site creation from streaming api.
I want a basic site creating in a fast and responsive format, such as react/node.js, possibly hosted on google cloud.
the site will tage the information from the api and create pages for each company.
There are over 14.5m companies registered over the years in the UK, and I would estimate that at least half of these are still active.
Because of the numbers involved, I think the streaming api is better, as they give out a data set initially to a set timepoint, at which the stream picks up.
The stream will also update existing records, which the rest api might not.
There are approximately 4000 new companies registered each week and each company will create a new page (or pages).
The stream is available in multiple formats and has around 4 different views, company, directors, financial submissions and an overview page. Logically these would be merged into one page.
This information is able to be used however we want, but it clearly needs to be ethical, which this is.
So, the summary is to deploy a database that wil generate pages for each business and adjust those pages according to the streaming dataset.
The deployment is for your choosing, as the expert, you should understand what is the most eficient method for this data task. The pages could be dynamic, but would need a sitemap being created so that they do exist somehwere in essence. There will also be a requirement to take a json feed to create a schema set for each page.
It should not really require daily manual input, especially if streaming is chosen over rest api.
I think that about covers it really. This is part one of a much bigger project, but I need to build out these steps to find the right working partner(s).
I look forward to hearing of prior experience and genuine understanding of site creation from streaming api.