Experienced Data Engineer for Automated Data Collection & Processing
Budget: $15 – $25 USD
[I WILL ONLY CONSIDER YOUR PROPOSAL IF YOU DESCRIBE RELEVANT PAST WORK/PROJECTS IN YOUR PROPOSAL. PLEASE READ THE ENTIRE DESCRIPTION BELOW TO GET A BETTER UNDERSTANDING OF WHAT IS NEEDED. THANK YOU]
I am looking for a Data Engineer who can help automate the collection and processing of data, utilizing web scraping technology, APIs, and python libraries like beautiful soup for processing.
For this project, the main tasks include:
- Designing and implementing effective scraping systems to collect and process data
- Integrating to our current system
Skills and Experience
Ideal candidates for this project should have:
- Proven experience in data engineering, API, ETL, and scraping projects.
- Proficiency in Python Libraries such as BeautifulSoup or Scrapy.
- Demonstrable past work related to data science or data engineering
Here are some additional details to help you understand the specific project requirements:
Background on What My Clients Need | Information to Help Salespeople:
I help sales teams perform better by providing them information about their prospects. My clients (companies) are looking for information that can help their salespeople personalize their outreach to prospective customers. As an example, let’s say I work for Microsoft. The Microsoft sales team will have challenges selling to ABC Manufacturing if they don’t know about the business priorities of ABC Manufacturing.
How I Serve my Clients Today | Public APIs and Keyword Matching:
If my client Microsoft wants to know the business priorities of ABC Manufacturing, I might use an API to gather the most recent news about ABC Manufacturing given a set of keywords (for example “productivity upgrades”). For example, I might find out in the news that ABC Manufacturing just mentioned in the local news that they are making “productivity upgrades.” I would then send an alert to the salesperson with the keyword + link to the article, so that they can use this as a reason to reach out to ABC Manufacturing.
Where I Need Your Help to Serve My Clients | Discover New Information and Process It
I need other public APIs to help these salespeople get information on their target accounts. One example would be upcoming government legislation. I would need your help finding the appropriate API to get upcoming legislation. I would also need your help structuring the data in a way that makes it very relevant and easy for sellers to use.
I am looking for a Data Engineer who can help automate the collection and processing of data, utilizing web scraping technology, APIs, and python libraries like beautiful soup for processing.
For this project, the main tasks include:
- Designing and implementing effective scraping systems to collect and process data
- Integrating to our current system
Skills and Experience
Ideal candidates for this project should have:
- Proven experience in data engineering, API, ETL, and scraping projects.
- Proficiency in Python Libraries such as BeautifulSoup or Scrapy.
- Demonstrable past work related to data science or data engineering
Here are some additional details to help you understand the specific project requirements:
Background on What My Clients Need | Information to Help Salespeople:
I help sales teams perform better by providing them information about their prospects. My clients (companies) are looking for information that can help their salespeople personalize their outreach to prospective customers. As an example, let’s say I work for Microsoft. The Microsoft sales team will have challenges selling to ABC Manufacturing if they don’t know about the business priorities of ABC Manufacturing.
How I Serve my Clients Today | Public APIs and Keyword Matching:
If my client Microsoft wants to know the business priorities of ABC Manufacturing, I might use an API to gather the most recent news about ABC Manufacturing given a set of keywords (for example “productivity upgrades”). For example, I might find out in the news that ABC Manufacturing just mentioned in the local news that they are making “productivity upgrades.” I would then send an alert to the salesperson with the keyword + link to the article, so that they can use this as a reason to reach out to ABC Manufacturing.
Where I Need Your Help to Serve My Clients | Discover New Information and Process It
I need other public APIs to help these salespeople get information on their target accounts. One example would be upcoming government legislation. I would need your help finding the appropriate API to get upcoming legislation. I would also need your help structuring the data in a way that makes it very relevant and easy for sellers to use.