Web Scraping using NodeJS
Budget: $30 – $250 USD
Project Title: Node.js Website Content Scraper and Summarizer for Business Intelligence
Budget: $150
Project Description:
We are seeking a proficient Node.js developer to create a script capable of scraping content from specified HTTP/HTTPS websites. The script should efficiently handle various website structures, apply logical filtering, and summarize the data focusing on services/products and contact information from the website of the company.
Key Responsibilities:
Website Scraping:
Develop a Node.js script for scraping content from designated HTTP/HTTPS websites.
Ensure the script can adapt to different website structures efficiently.
Conditional Logic Implementation:
Non-Existent Websites: The script should verify website existence and skip non-existent ones.
Click Feed Domain Filter: Add logic to bypass websites that use click feed domains (e.g., http://www.airfitac.com/).
Specific Data Capture:
Focus on extracting details about the company's services and/or products.
As an example of what we are looking to extract, please look at the section below labeled ::::EXAMPLE DATA:::::
Data Summarization and Export:
Summarize the scraped data, emphasizing services/products and contact details.
Export the data in a structured format like JSON or CSV.
Skills Required:
Proficiency in Node.js and web scraping.
Knowledge of HTTP/HTTPS protocols and web content structures.
Skill in implementing conditional logic.
Experience in data processing, summarization, and targeted data extraction.
Deliverables:
A Node.js script that meets the specified requirements.
Comprehensive documentation on script usage, including setup, input parameters, and output format.
Project Timeline: Completion within [specify timeline, e.g., 2 Days].
Application Instructions:
Submit a proposal highlighting:
Your experience with similar projects.
Your approach to this task, including technical tools you plan to use.
Any queries regarding the project requirements.
::::::EXAMPLE DATA::::::
Domain:https://www.topnotchplumbinganddrain.com/
Services Offered:
Plumbing Installation
Gas Line Plumbing
Water Treatment
Water Heaters
Water Lines
Sewer Services
Plumbing Repairs
Commercial Plumbing
About Us:
Top Notch Plumbing and Drain is a leading plumber in Gilbert, AZ. We have more than 30 years of combined experience in the plumbing industry and we offer residential and commercial plumbing services. We are a locally owned and operated company that are fully licensed and insured, and we are also a Licensed Master Plumber. Get in touch with us today for all your plumbing needs.
Our services include:
Repairs & Service
Installations & Replacement
Gas, Water & Sewer
Purification Services
Residential Plumbing
Commercial Plumbing
Serving Gilbert, AZ
Main Office
Gilbert, AZ 85298
480-526-9152
License #ROC 320403
Payment Terms:
No payments in advance
The payment for this project will be escrowed on freelancer platform upon the completion of the project and testing.
The freelancer will be paid in full upon successful completion of the project and testing.
Terms:
All intellectual property developed as part of this project will be owned by our company.
Confidentiality of work and project shall be agreed upon by chosen freelancer.
Please Mention in your response (so we know you read the entire project details): Lets Scrape!
Budget: $150
Project Description:
We are seeking a proficient Node.js developer to create a script capable of scraping content from specified HTTP/HTTPS websites. The script should efficiently handle various website structures, apply logical filtering, and summarize the data focusing on services/products and contact information from the website of the company.
Key Responsibilities:
Website Scraping:
Develop a Node.js script for scraping content from designated HTTP/HTTPS websites.
Ensure the script can adapt to different website structures efficiently.
Conditional Logic Implementation:
Non-Existent Websites: The script should verify website existence and skip non-existent ones.
Click Feed Domain Filter: Add logic to bypass websites that use click feed domains (e.g., http://www.airfitac.com/).
Specific Data Capture:
Focus on extracting details about the company's services and/or products.
As an example of what we are looking to extract, please look at the section below labeled ::::EXAMPLE DATA:::::
Data Summarization and Export:
Summarize the scraped data, emphasizing services/products and contact details.
Export the data in a structured format like JSON or CSV.
Skills Required:
Proficiency in Node.js and web scraping.
Knowledge of HTTP/HTTPS protocols and web content structures.
Skill in implementing conditional logic.
Experience in data processing, summarization, and targeted data extraction.
Deliverables:
A Node.js script that meets the specified requirements.
Comprehensive documentation on script usage, including setup, input parameters, and output format.
Project Timeline: Completion within [specify timeline, e.g., 2 Days].
Application Instructions:
Submit a proposal highlighting:
Your experience with similar projects.
Your approach to this task, including technical tools you plan to use.
Any queries regarding the project requirements.
::::::EXAMPLE DATA::::::
Domain:https://www.topnotchplumbinganddrain.com/
Services Offered:
Plumbing Installation
Gas Line Plumbing
Water Treatment
Water Heaters
Water Lines
Sewer Services
Plumbing Repairs
Commercial Plumbing
About Us:
Top Notch Plumbing and Drain is a leading plumber in Gilbert, AZ. We have more than 30 years of combined experience in the plumbing industry and we offer residential and commercial plumbing services. We are a locally owned and operated company that are fully licensed and insured, and we are also a Licensed Master Plumber. Get in touch with us today for all your plumbing needs.
Our services include:
Repairs & Service
Installations & Replacement
Gas, Water & Sewer
Purification Services
Residential Plumbing
Commercial Plumbing
Serving Gilbert, AZ
Main Office
Gilbert, AZ 85298
480-526-9152
License #ROC 320403
Payment Terms:
No payments in advance
The payment for this project will be escrowed on freelancer platform upon the completion of the project and testing.
The freelancer will be paid in full upon successful completion of the project and testing.
Terms:
All intellectual property developed as part of this project will be owned by our company.
Confidentiality of work and project shall be agreed upon by chosen freelancer.
Please Mention in your response (so we know you read the entire project details): Lets Scrape!