I need a python developer asap
Budget: $10 – $30 USD
I have a simple python tool that allows me to create mass landing pages from a spreadsheet.
I want to be able to create 200k+ pages from a spreadsheet with 200k+ rows within an hour or a few hours. And I want to be able repeat the process without slowing down the server or database. I have more than 1,000 spreadsheets and each has more than 200k rows in them.
However, it takes more than 24 hours to create 50k pages.
The problem is that once I upload a spreadsheet in the frontend of the tool, it takes about an hour to create the first 10k pages. After that, the next hour will be around 2k pages, next hour will be around 200 pages, and so on. I even tried a spreadsheet with just 6k rows, but that didn't work either. It took more than an hour to create the first 500 pages and the next hour was like 100 pages.
The tool is hosted on DigitalOcean using droplet. I've tried several droplet upgrades and even switched to using AWS RDS dB.m5.xlarge, nothing worked.
====================================================
I may not share my server details for now for security reasons. However, if you're interested, kindly drop me your GitHub ID/username in the chat so I can invite you to the repo. That way, uou can have access the source code and then follow the below steps:
HERE'S HOW THE TOOL WORKS:
1. You will need to host the app on your localhost, register, login, and follow the next steps;
2. Go to /framework/brands/create/ to create a brand. A brand is like a business page. I will send you the screenshot of the sample data you can enter in the brand creation form.
3. Then go to /framework/passages/create/ to create passages. Passages are dynamic landing pages. I will send you the screenshot of the sample data you can enter in the passage creation form.
DUMMY DATA A > there are 10 rows in this Spreadsheet. You can first test with this.
https://docs.google.com/spreadsheets/d/1hiKp74iLZ1diFhH7PiJ4-CJM9u4cKIIO_VM9e4gb6ek/edit?usp=sharing
DUMMY DATA B > there are 200k rows in this Spreadsheet. This is where you will see the problem.
https://docs.google.com/spreadsheets/d/1n5zNYhqPLcI4VpK1_nKgQEK7ry300HWjaEtOgXuAhAw/edit?usp=sharing
Cheers,
Banjo
I want to be able to create 200k+ pages from a spreadsheet with 200k+ rows within an hour or a few hours. And I want to be able repeat the process without slowing down the server or database. I have more than 1,000 spreadsheets and each has more than 200k rows in them.
However, it takes more than 24 hours to create 50k pages.
The problem is that once I upload a spreadsheet in the frontend of the tool, it takes about an hour to create the first 10k pages. After that, the next hour will be around 2k pages, next hour will be around 200 pages, and so on. I even tried a spreadsheet with just 6k rows, but that didn't work either. It took more than an hour to create the first 500 pages and the next hour was like 100 pages.
The tool is hosted on DigitalOcean using droplet. I've tried several droplet upgrades and even switched to using AWS RDS dB.m5.xlarge, nothing worked.
====================================================
I may not share my server details for now for security reasons. However, if you're interested, kindly drop me your GitHub ID/username in the chat so I can invite you to the repo. That way, uou can have access the source code and then follow the below steps:
HERE'S HOW THE TOOL WORKS:
1. You will need to host the app on your localhost, register, login, and follow the next steps;
2. Go to /framework/brands/create/ to create a brand. A brand is like a business page. I will send you the screenshot of the sample data you can enter in the brand creation form.
3. Then go to /framework/passages/create/ to create passages. Passages are dynamic landing pages. I will send you the screenshot of the sample data you can enter in the passage creation form.
DUMMY DATA A > there are 10 rows in this Spreadsheet. You can first test with this.
https://docs.google.com/spreadsheets/d/1hiKp74iLZ1diFhH7PiJ4-CJM9u4cKIIO_VM9e4gb6ek/edit?usp=sharing
DUMMY DATA B > there are 200k rows in this Spreadsheet. This is where you will see the problem.
https://docs.google.com/spreadsheets/d/1n5zNYhqPLcI4VpK1_nKgQEK7ry300HWjaEtOgXuAhAw/edit?usp=sharing
Cheers,
Banjo