Pyspark Revenue Forecasting Pipeline Optimisation
Budget: ₹750 – ₹1,250 INR
I am looking to develop a sophisticated and efficient data pipeline for revenue forecasting. This pipeline will be implemented using Python, pyspark, databrics, and gcp Big Data. Here is what you need to know about this task:
- Data Source: The data originates from Google Cloud Platform's Big Data service. As such, the freelancer should have solid experience and understanding of working with Big Data services on GCP.
- Data Update Frequency: The frequency of data updates will be confirmed during the project, but suffice to say frequency could be high. Prior experience with real-time or near-real-time data processing will be highly beneficial.
- Performance Metrics: The key performance metric I'm focusing on is data processing speed. The freelancer should have a strong knowledge of performance optimization, specifically for speeding up data processing within a data pipeline.
To be successful in this role, solid experience in Python, PySpark, and Databricks is a must, along with a proven track record in time series forecasting and revenue prediction work. A good understanding of Big Data on GCP and data pipeline optimization will certainly make you stand out.
- Data Source: The data originates from Google Cloud Platform's Big Data service. As such, the freelancer should have solid experience and understanding of working with Big Data services on GCP.
- Data Update Frequency: The frequency of data updates will be confirmed during the project, but suffice to say frequency could be high. Prior experience with real-time or near-real-time data processing will be highly beneficial.
- Performance Metrics: The key performance metric I'm focusing on is data processing speed. The freelancer should have a strong knowledge of performance optimization, specifically for speeding up data processing within a data pipeline.
To be successful in this role, solid experience in Python, PySpark, and Databricks is a must, along with a proven track record in time series forecasting and revenue prediction work. A good understanding of Big Data on GCP and data pipeline optimization will certainly make you stand out.