Energy Comparison Sites Web Crawler
Budget: $30 – $250 AUD
Web Crawler Development for Energy Comparison Websites
Job Title: Develop a Web Crawler to Extract and Display Data on My Website
Job Description:
I am looking for an experienced developer to create a web crawler that can extract specific information from two energy comparison websites and display the data in tables on my website. The crawler should be efficient, reliable, and easy to maintain.
Websites to Crawl:
https://compare.energy.vic.gov.au/
https://www.energymadeeasy.gov.au/
Key Requirements:
The web crawler should extract specific data points such as energy plans, pricing, discounts, and other relevant details.
The extracted data should be displayed in a clean, organized table format on my website.
The crawler should be able to handle updates and changes in the structure of the target websites.
Ensure compliance with the terms of service of the target websites.
Provide documentation on how to use and maintain the crawler.
Skills Required:
Web scraping
Data extraction
Python (or any other relevant programming language)
HTML/CSS
Experience with libraries like BeautifulSoup, Scrapy, or Selenium
Knowledge of handling dynamic content (JavaScript-heavy websites)
Preferred Qualifications:
Previous experience with energy-related data extraction
Familiarity with Australian energy market websites
Experience with data visualization and table formatting
Project Timeline:
Expected completion within 2-3 weeks
Budget:
Please provide your estimated cost for this project.
How to Apply:
Please submit your proposal including:
A brief overview of your experience with web scraping and data extraction.
Examples of similar projects you have completed.
Your estimated timeline and cost for this project.
Any additional suggestions or insights you have for this project.
Contact Information:
Feel free to message me with any questions or clarifications regarding the project.
Looking forward to working with a skilled professional who can deliver a high-quality web crawler tailored to my needs.
Thank you!
Job Title: Develop a Web Crawler to Extract and Display Data on My Website
Job Description:
I am looking for an experienced developer to create a web crawler that can extract specific information from two energy comparison websites and display the data in tables on my website. The crawler should be efficient, reliable, and easy to maintain.
Websites to Crawl:
https://compare.energy.vic.gov.au/
https://www.energymadeeasy.gov.au/
Key Requirements:
The web crawler should extract specific data points such as energy plans, pricing, discounts, and other relevant details.
The extracted data should be displayed in a clean, organized table format on my website.
The crawler should be able to handle updates and changes in the structure of the target websites.
Ensure compliance with the terms of service of the target websites.
Provide documentation on how to use and maintain the crawler.
Skills Required:
Web scraping
Data extraction
Python (or any other relevant programming language)
HTML/CSS
Experience with libraries like BeautifulSoup, Scrapy, or Selenium
Knowledge of handling dynamic content (JavaScript-heavy websites)
Preferred Qualifications:
Previous experience with energy-related data extraction
Familiarity with Australian energy market websites
Experience with data visualization and table formatting
Project Timeline:
Expected completion within 2-3 weeks
Budget:
Please provide your estimated cost for this project.
How to Apply:
Please submit your proposal including:
A brief overview of your experience with web scraping and data extraction.
Examples of similar projects you have completed.
Your estimated timeline and cost for this project.
Any additional suggestions or insights you have for this project.
Contact Information:
Feel free to message me with any questions or clarifications regarding the project.
Looking forward to working with a skilled professional who can deliver a high-quality web crawler tailored to my needs.
Thank you!