Python Script for Novel Scraping
Budget: $14 – $30 NZD
I am looking for a Python script that can scrape novels from noveldramas.com. The script should be able to:
- Handle all scraping activities on the website, ensuring no ads, HTML, or other irrelevant content are included.
- Fetch the content of each chapter in raw text format, excluding everything else.
- Provide the extracted content in plain text with appropriate line breaks.
- Manage chapters that are divided across multiple pages by creating a separate text file for each part, while also including a main text file that links to these separate files.
- usage of proxies to download the data
- ability for script to download multiple pages at once to speed up the process.
The ideal candidate for this project should have:
- Proficiency in Python, especially in web scraping.
- Experience in text processing and manipulation
- when posting for this project use the word aardvark so I know you bothered to read the description.
- Knowledge of file handling and data organization.
- Familiarity with extracting content from websites with multiple pages.
- Good communication skills to ensure project requirements are met effectively.
Example url https://noveldramas.novelupdates.net/book/life-at-the-top/chapter-1
- Handle all scraping activities on the website, ensuring no ads, HTML, or other irrelevant content are included.
- Fetch the content of each chapter in raw text format, excluding everything else.
- Provide the extracted content in plain text with appropriate line breaks.
- Manage chapters that are divided across multiple pages by creating a separate text file for each part, while also including a main text file that links to these separate files.
- usage of proxies to download the data
- ability for script to download multiple pages at once to speed up the process.
The ideal candidate for this project should have:
- Proficiency in Python, especially in web scraping.
- Experience in text processing and manipulation
- when posting for this project use the word aardvark so I know you bothered to read the description.
- Knowledge of file handling and data organization.
- Familiarity with extracting content from websites with multiple pages.
- Good communication skills to ensure project requirements are met effectively.
Example url https://noveldramas.novelupdates.net/book/life-at-the-top/chapter-1