github repos python scraping
Budget: $10 – $30 USD
USE AMAZON LAMDA
write python code and run on AWS Lambda (teach me how to use AWS Lambda)
for example , you have link
https://github.com/search?q=xgboost+time+series
and you should write python code to download all repos from all folders like
["repositories", "discussions" , "issues" , etc]
and unzip them
AVOID GIHUB BAN IF THERE ARE MANY REPOS TO DOWNLAOD
FOR EXAMPLE 1000 REPOS, THEN GITHUB WILL TRY STOP DOWNLOADING
for example
https://github.com/vim-scripts
write python code and run on AWS Lambda (teach me how to use AWS Lambda)
for example , you have link
https://github.com/search?q=xgboost+time+series
and you should write python code to download all repos from all folders like
["repositories", "discussions" , "issues" , etc]
and unzip them
AVOID GIHUB BAN IF THERE ARE MANY REPOS TO DOWNLAOD
FOR EXAMPLE 1000 REPOS, THEN GITHUB WILL TRY STOP DOWNLOADING
for example
https://github.com/vim-scripts