Craw website, store data on DB and send data to user using Telegram API
Budget: $10 – $30 USD
1. Do pagination on an page exactly like this: https://rs.olx.com.br/autos-e-pecas/carros-vans-e-utilitarios , i need
2. Open each ad at the pages of step 1, see exemple: https://rs.olx.com.br/regioes-de-porto-alegre-torres-e-santa-cruz-do-sul/autos-e-pecas/carros-vans-e-utilitarios/vw-amarok-2013-bx-km-965201638
3. Craw data page of step 2
4. Store some fields of the page on MySQL DB, you will need to create the DB
5. Send data of each new ad to my Telegram using telegram API, filter ads to send me by price and location (simple numeric operators and string comparasion)
6. Check if old ads registered on DB still online, if is not online anymore insert on database the date wich it goes offline (check 3 times, on different runs before insert this info)
Run the process at each 1 hour.
You will use an Amazon VPS wich I have.
Code need be in Python
2. Open each ad at the pages of step 1, see exemple: https://rs.olx.com.br/regioes-de-porto-alegre-torres-e-santa-cruz-do-sul/autos-e-pecas/carros-vans-e-utilitarios/vw-amarok-2013-bx-km-965201638
3. Craw data page of step 2
4. Store some fields of the page on MySQL DB, you will need to create the DB
5. Send data of each new ad to my Telegram using telegram API, filter ads to send me by price and location (simple numeric operators and string comparasion)
6. Check if old ads registered on DB still online, if is not online anymore insert on database the date wich it goes offline (check 3 times, on different runs before insert this info)
Run the process at each 1 hour.
You will use an Amazon VPS wich I have.
Code need be in Python