Quick Trendlyne Stock Scraper
Budget: ₹1,500 – ₹12,500 INR
I'm looking for a skilled freelancer to create a dynamic web scraping tool tailored for Trendlyne to capture specific stock information across multiple pages. The data fetched is actually a CSV file which is then saved to mongoDB for easy review and analysis.
**Key Requirements:**
- Utilize Trendlyne to fetch a list of stock names available
- Develop a scraper that can efficiently navigate through one page but for multiple stocks, differentiated only by the stock names, to collect comprehensive data on each.
- Implement a function to compile and download the aggregated data in a CSV format for each stock name, which is then saved to mongoDB.
- Everyday run, which updates DB with latest score of the stocks for dates for which it is not updated.
- Ensure the solution is scalable and easily updated, considering the potential addition of more stock names or changes in the website’s structure.
**Ideal Skills and Experience:**
- Proficiency in web scraping tools and technologies such as Python, BeautifulSoup, Scrapy, or equivalent frameworks.
- Experience with data manipulation and exporting to formats such as CSV and MongoDB
- Knowledge of and previous work with financial or stock market data is highly beneficial.
- Ability to work quickly and efficiently, with a focus on delivering the project ASAP without compromising on quality.
- Strong problem-solving skills and the ability to navigate potential obstacles, such as website anti-scraping mechanisms.
This project is high priority, and I am looking to get started immediately. Please apply if you have the necessary experience and are able to commit to a fast turnaround.
**Key Requirements:**
- Utilize Trendlyne to fetch a list of stock names available
- Develop a scraper that can efficiently navigate through one page but for multiple stocks, differentiated only by the stock names, to collect comprehensive data on each.
- Implement a function to compile and download the aggregated data in a CSV format for each stock name, which is then saved to mongoDB.
- Everyday run, which updates DB with latest score of the stocks for dates for which it is not updated.
- Ensure the solution is scalable and easily updated, considering the potential addition of more stock names or changes in the website’s structure.
**Ideal Skills and Experience:**
- Proficiency in web scraping tools and technologies such as Python, BeautifulSoup, Scrapy, or equivalent frameworks.
- Experience with data manipulation and exporting to formats such as CSV and MongoDB
- Knowledge of and previous work with financial or stock market data is highly beneficial.
- Ability to work quickly and efficiently, with a focus on delivering the project ASAP without compromising on quality.
- Strong problem-solving skills and the ability to navigate potential obstacles, such as website anti-scraping mechanisms.
This project is high priority, and I am looking to get started immediately. Please apply if you have the necessary experience and are able to commit to a fast turnaround.