Finalize Apify Data Pipeline and Dashboard
Budget: $1,500 – $3,000 USD
I have an Apify based data pipeline already running. The previous developer completed the setup and delivered working scrapers, schedules, and a BigQuery connection. I need a developer to review the build, stabilize it, and finish the remaining pieces.
What is already done:
Apify organization created
Two working Actors running on schedule
Facebook Posts Scraper
Instagram Profile Scraper
Existing saved tasks
Storage dataset creation
Service account permissions set
BigQuery dataset ready
Tables receiving data daily
What I need completed:
Confirm Actors run without failure
Add retry logic and error handling
Clean and structure the scraped data
Write transformations for sentiment and keyword flags
Load cleaned data into final BigQuery tables
Build a Looker Studio dashboard using these tables
Document the workflow
Advise on improvements and long term stability
Skills required:
Apify Actors
Node or Python
BigQuery
Google Cloud IAM
Looker Studio
ETL best practices
I want someone who can work quickly, communicate clearly, and complete the remaining steps without redoing what is already built.
If you are interested, share:
Your experience with Apify and BigQuery
One example of a pipeline you built
Your estimated timeline
This is not a full rebuild. I need a strong finisher to stabilize and complete the system.
What is already done:
Apify organization created
Two working Actors running on schedule
Facebook Posts Scraper
Instagram Profile Scraper
Existing saved tasks
Storage dataset creation
Service account permissions set
BigQuery dataset ready
Tables receiving data daily
What I need completed:
Confirm Actors run without failure
Add retry logic and error handling
Clean and structure the scraped data
Write transformations for sentiment and keyword flags
Load cleaned data into final BigQuery tables
Build a Looker Studio dashboard using these tables
Document the workflow
Advise on improvements and long term stability
Skills required:
Apify Actors
Node or Python
BigQuery
Google Cloud IAM
Looker Studio
ETL best practices
I want someone who can work quickly, communicate clearly, and complete the remaining steps without redoing what is already built.
If you are interested, share:
Your experience with Apify and BigQuery
One example of a pipeline you built
Your estimated timeline
This is not a full rebuild. I need a strong finisher to stabilize and complete the system.