Development of a crawler for data extraction
Budget: $30 – $250 USD
Please send a proposal with a delivery time and price for development; we won't respond without these details.
We need a web crawler to visit the following websites:
https://esaj.tjsp.jus.br/cpopg/open.do
https://esaj.tjce.jus.br/cpopg/open.do
https://consultaprocessual.tjmt.jus.br
https://consulta.tjpr.jus.br/projudi_consulta/
https://www.tjrs.jus.br/novo/busca/?return=proc&client=wp_index
After accessing each site, the system should find specific legal cases using process numbers provided in a CSV file.
CSV format:
Site - Process number
TJSP.jus.br; 10026526852787245829
TJRS.jus.br; 274157715592754419
Once the search is done, the system should log in and access the private area of each case.
Within the private area, the system should click on the "contract" tab, which will open a PDF in the web browser.
With the PDF open, the system should extract the following information from the PDF: CPF (Brazilian ID number), Phone, and Email.
(Content formats:
CPF 34262772676 or CPF 123.728.564-24)
After extracting all the information, the system should generate a CSV file on the source PC's desktop in the following format:
Process number; CPF; Phone; Email
Note: Not all cases will have phone and email, but all cases will have a CPF.
The system will handle an average of 1500 process numbers in total.
If the system encounters any errors on a website, it should move on to the next process.
The system should also include a field to change login and password when necessary.
You can use the following project as a reference: https://github.com/luan-grabher/VMB-ADV-Leads
Thank you.
We need a web crawler to visit the following websites:
https://esaj.tjsp.jus.br/cpopg/open.do
https://esaj.tjce.jus.br/cpopg/open.do
https://consultaprocessual.tjmt.jus.br
https://consulta.tjpr.jus.br/projudi_consulta/
https://www.tjrs.jus.br/novo/busca/?return=proc&client=wp_index
After accessing each site, the system should find specific legal cases using process numbers provided in a CSV file.
CSV format:
Site - Process number
TJSP.jus.br; 10026526852787245829
TJRS.jus.br; 274157715592754419
Once the search is done, the system should log in and access the private area of each case.
Within the private area, the system should click on the "contract" tab, which will open a PDF in the web browser.
With the PDF open, the system should extract the following information from the PDF: CPF (Brazilian ID number), Phone, and Email.
(Content formats:
CPF 34262772676 or CPF 123.728.564-24)
After extracting all the information, the system should generate a CSV file on the source PC's desktop in the following format:
Process number; CPF; Phone; Email
Note: Not all cases will have phone and email, but all cases will have a CPF.
The system will handle an average of 1500 process numbers in total.
If the system encounters any errors on a website, it should move on to the next process.
The system should also include a field to change login and password when necessary.
You can use the following project as a reference: https://github.com/luan-grabher/VMB-ADV-Leads
Thank you.