E-commerce Text Data Scraping Expert
Budget: $8 – $15 AUD
I'm in need of a professional who can scrape text data from various e-commerce sites. The primary purpose for this task is to gather data for competitor analysis.
Key Requirements:
- Expertise in web scraping and data extraction
- Experience in scraping text data from e-commerce websites
- Understanding of competitor analysis in the e-commerce sector
- Ability to deliver the data in a structured and easy-to-understand format
The ideal freelancer for this project would have a proven track record in data scraping, particularly in the e-commerce sector. Familiarity with tools and techniques for competitor analysis is also essential.
here is the Scope
Title
Build a Web Crawler in Magento
Description
[ Certified Magento developer Only ]
I need a web crawler with the following specifications:
Platform: Magento
Input: URL
Output: Capture up to 5 attributes and store the data in a
Magento database
• Magento Integration:
Implement everything within the Magento framework.
• Database Creation:
Set up a database on the Magento server to store the crawled data.
• Crawler Development:
Develop a web crawler that can extract data from a specified web page URL.
• Configuration Settings:
The crawler should operate based on configuration settings, including the number of targets to crawl per hour.
• Data Output:
Store the crawled data in the Magento database.
• Initial Operation:
Begin with manual operations to ensure everything runs smoothly.
• Scheduled Automation:
Once verified, implement a scheduled task (Cron Job) based on the settings in configuration
• Summary Report:
Generate a summary report for each run and send it via email.
• Bot Protection:
Address and solve issues related to bot detection and blocking mechanisms.
Key Requirements:
- Expertise in web scraping and data extraction
- Experience in scraping text data from e-commerce websites
- Understanding of competitor analysis in the e-commerce sector
- Ability to deliver the data in a structured and easy-to-understand format
The ideal freelancer for this project would have a proven track record in data scraping, particularly in the e-commerce sector. Familiarity with tools and techniques for competitor analysis is also essential.
here is the Scope
Title
Build a Web Crawler in Magento
Description
[ Certified Magento developer Only ]
I need a web crawler with the following specifications:
Platform: Magento
Input: URL
Output: Capture up to 5 attributes and store the data in a
Magento database
• Magento Integration:
Implement everything within the Magento framework.
• Database Creation:
Set up a database on the Magento server to store the crawled data.
• Crawler Development:
Develop a web crawler that can extract data from a specified web page URL.
• Configuration Settings:
The crawler should operate based on configuration settings, including the number of targets to crawl per hour.
• Data Output:
Store the crawled data in the Magento database.
• Initial Operation:
Begin with manual operations to ensure everything runs smoothly.
• Scheduled Automation:
Once verified, implement a scheduled task (Cron Job) based on the settings in configuration
• Summary Report:
Generate a summary report for each run and send it via email.
• Bot Protection:
Address and solve issues related to bot detection and blocking mechanisms.