Data Scraping from Dynamic Website
Budget: ₹600 – ₹1,500 INR
I need a skilled web scraper to extract data from a dynamic website for me.
Data is presented in a table format, with each page containing 500 rows. The last column contains a "view" button. Upon clicking this button, a pop-up appears containing additional data that I want to extract. There are 260 pages in total, with a grand total of 130,000 rows.
Key requirements:
- Navigate through the pages by clicking the numbered buttons at the end of each page (1, 2, 3, 4, etc.)
- Collect all data from each page
- Save all data into an SQL database
The main URL of the website remains the same for every page, even before and after submitting my search criteria. Although this is a one-time extraction, I'm looking for someone with experience in handling JavaScript-based systems.
Ideal skills and experience:
- Proficiency in web scraping
- Experience with JavaScript-based systems
- Ability to deliver data in SQL format
- Familiarity with handling pop-up windows during data extraction
Please note, I do not need to handle potential pop-up blockers, nor do I require the data scraping to be automated for repeated use. I only need a one-time extraction of text data from the website.
Data is presented in a table format, with each page containing 500 rows. The last column contains a "view" button. Upon clicking this button, a pop-up appears containing additional data that I want to extract. There are 260 pages in total, with a grand total of 130,000 rows.
Key requirements:
- Navigate through the pages by clicking the numbered buttons at the end of each page (1, 2, 3, 4, etc.)
- Collect all data from each page
- Save all data into an SQL database
The main URL of the website remains the same for every page, even before and after submitting my search criteria. Although this is a one-time extraction, I'm looking for someone with experience in handling JavaScript-based systems.
Ideal skills and experience:
- Proficiency in web scraping
- Experience with JavaScript-based systems
- Ability to deliver data in SQL format
- Familiarity with handling pop-up windows during data extraction
Please note, I do not need to handle potential pop-up blockers, nor do I require the data scraping to be automated for repeated use. I only need a one-time extraction of text data from the website.