Create database, ingesting , enhancing and exporting data
Budget: $30 – $250 USD
I will be scraping job listing information from 15 recruitment consultancy sites on a regular basis; daily/weekly/monthly. This activity does NOT form part of this job.
These 15 feeds of data will be sent to you in a common format (.csv, .json, .txt )
I will map the fields from each source to a standard data structure (see fields below) These feeds need to be uploaded into a cloud database, mapping the feeds to the standard data structure.
Date Posted
Start Date
Expiry Date
Job Title
Salary Details
Location
Country
Job Description
Sector
Company name
Application Email
Application URL
Remote position
Working Pattern
Job Type
Vacancy Reference
Contact Email
Contact
Job Category
Publish
Once in the table, I will need a simple UI/frontend that allows me to categorize the “Job Category” each entry using the following categories on a dropdown;
Data Analyst
Data Engineer
Data Scientist
Business Analyst
Data Architect
Other
Once in the table, I will need a simple UI/frontend that allows me to categorize each entry in the “Publish” field Yes or No. The default setting will be Publish = No
I will then need an option to export all data where Publish = Yes. The data will be exported as a .csv file
Each Day/Week/Month 15 updated feeds from the original 15 recruitment consultancy sites will be sent to you in a common format (.csv, .json, .txt ). These feeds will include only the updated data compared with the last day /week/month. The new data will be put into the database as above, and the fields “Job Category” and “Publish” will be selected. The new data will be exported from the database.
Please make sure to deliver a sample ASAP!
These 15 feeds of data will be sent to you in a common format (.csv, .json, .txt )
I will map the fields from each source to a standard data structure (see fields below) These feeds need to be uploaded into a cloud database, mapping the feeds to the standard data structure.
Date Posted
Start Date
Expiry Date
Job Title
Salary Details
Location
Country
Job Description
Sector
Company name
Application Email
Application URL
Remote position
Working Pattern
Job Type
Vacancy Reference
Contact Email
Contact
Job Category
Publish
Once in the table, I will need a simple UI/frontend that allows me to categorize the “Job Category” each entry using the following categories on a dropdown;
Data Analyst
Data Engineer
Data Scientist
Business Analyst
Data Architect
Other
Once in the table, I will need a simple UI/frontend that allows me to categorize each entry in the “Publish” field Yes or No. The default setting will be Publish = No
I will then need an option to export all data where Publish = Yes. The data will be exported as a .csv file
Each Day/Week/Month 15 updated feeds from the original 15 recruitment consultancy sites will be sent to you in a common format (.csv, .json, .txt ). These feeds will include only the updated data compared with the last day /week/month. The new data will be put into the database as above, and the fields “Job Category” and “Publish” will be selected. The new data will be exported from the database.
Please make sure to deliver a sample ASAP!