Google Upload Cloud Storage Speed Increase
Budget: $250 – $750 AUD
Hi guys,
Our website is a marketplace platform where sellers can upload images of their products. The logic currently is that images are saved directly to our server (not to our google bucket). We have noticed that 20mb or 25mb images are taking 20-25 second to upload. Smaller size images upload in 2-3 seconds (no problems).
So we have set up a beta server, and changed the logic so customer images are saved directly to the bucket. However, the large images are still taking 20-25 second to upload, so the issue is not resolved.
We have uploaded the same image direct to the bucket, and it took 20 seconds, and then when uploading on the website it also took around 20 seconds. So the upload speed is slow for larger images on both direct bucket upload and via our website.
When i have done the same test via the gsutil comand, it uploads much faster to our server directly, but we are unsure how to apply this so when customers upload images on our website , it uploads in that same quick speed. Google support also said we can a parallel composite upload with a threshold (https://www.doit-intl.com/optimize-data-transfer-between-compute-engine-and-cloud-storage/), and there is many other options available also.
Our website is a marketplace platform where sellers can upload images of their products. The logic currently is that images are saved directly to our server (not to our google bucket). We have noticed that 20mb or 25mb images are taking 20-25 second to upload. Smaller size images upload in 2-3 seconds (no problems).
So we have set up a beta server, and changed the logic so customer images are saved directly to the bucket. However, the large images are still taking 20-25 second to upload, so the issue is not resolved.
We have uploaded the same image direct to the bucket, and it took 20 seconds, and then when uploading on the website it also took around 20 seconds. So the upload speed is slow for larger images on both direct bucket upload and via our website.
When i have done the same test via the gsutil comand, it uploads much faster to our server directly, but we are unsure how to apply this so when customers upload images on our website , it uploads in that same quick speed. Google support also said we can a parallel composite upload with a threshold (https://www.doit-intl.com/optimize-data-transfer-between-compute-engine-and-cloud-storage/), and there is many other options available also.