Job Portal Data Scraping & Analysis
Budget: $3 – $10 SGD
I need someone to continue my project of scraping specific job portals, storing data in Supabase, and pushing it to my Google Sheet.
Key Responsibilities:
1. Scrape data from specific job portals according to my list.
2. Store the data in my Supabase database.
3. Transfer data from Supabase to my Google Sheet, adhering to a specific format.
4. Set up a cron job on my server to scrape data every two weeks, with an auto-pause feature when not in use.
5. Use a GPT prompt to score each row of data.
Ideal Skills:
- Proficient in data scraping and using tools like Python, BeautifulSoup or Scrapy.
- Familiar with Supabase, Google Sheets, and setting up cron jobs.
- Experience with using GPT for data analysis.
Please note, we're scraping data related to job titles, descriptions, and company details.
Key Responsibilities:
1. Scrape data from specific job portals according to my list.
2. Store the data in my Supabase database.
3. Transfer data from Supabase to my Google Sheet, adhering to a specific format.
4. Set up a cron job on my server to scrape data every two weeks, with an auto-pause feature when not in use.
5. Use a GPT prompt to score each row of data.
Ideal Skills:
- Proficient in data scraping and using tools like Python, BeautifulSoup or Scrapy.
- Familiar with Supabase, Google Sheets, and setting up cron jobs.
- Experience with using GPT for data analysis.
Please note, we're scraping data related to job titles, descriptions, and company details.