YP Scrapy - Python - Developer ! Writing script
Budget: €30 – €250 EUR
Python Scrapy/beautifull soup
- always yelow pages type of webs
- yaml configuration file
- save results to .db file - name changable
- url - with variables: city, keyword, listingloop
- list of 15 columns for listings page
- scrape also company-profile page? (false/true)
- if true scrape also company-profile page: 15 columns also (can be done combination of both groups - column filled by lisitg page - will not be set on profile page - already have value in table)
- Sleep mode: x pages , y seconds to wait
- use css selectors or xpaths (but i preffer css selectors)
- always yelow pages type of webs
- yaml configuration file
- save results to .db file - name changable
- url - with variables: city, keyword, listingloop
- list of 15 columns for listings page
- scrape also company-profile page? (false/true)
- if true scrape also company-profile page: 15 columns also (can be done combination of both groups - column filled by lisitg page - will not be set on profile page - already have value in table)
- Sleep mode: x pages , y seconds to wait
- use css selectors or xpaths (but i preffer css selectors)