Google Cloud Function for Wikimedia Data Collection -- 2
Budget: €30 – €250 EUR
I'm looking for a talented developer to create a Google Cloud Function in Python for me. This function will collect page edits data from stream.wikimedia.org and securely store it in a Google Cloud Platform bucket in Parquet format.
Key Responsibilities:
- Develop a Google Cloud Function in Python.
- Efficiently collect page edits data from stream.wikimedia.org having parameters like date/end point/max size.
- Store the data securely in a Google Cloud Platform bucket.
- Format the data in Parquet format before storage.
- Provided detailed information about how to deploy in production
Ideal Skills and Experience:
- Proven experience with Google Cloud Functions and GCP storage solutions.
- Proficiency in Python.
- Strong background in cloud computing and data handling.
- Experience with data formatting, specifically in Parquet format.
Key Responsibilities:
- Develop a Google Cloud Function in Python.
- Efficiently collect page edits data from stream.wikimedia.org having parameters like date/end point/max size.
- Store the data securely in a Google Cloud Platform bucket.
- Format the data in Parquet format before storage.
- Provided detailed information about how to deploy in production
Ideal Skills and Experience:
- Proven experience with Google Cloud Functions and GCP storage solutions.
- Proficiency in Python.
- Strong background in cloud computing and data handling.
- Experience with data formatting, specifically in Parquet format.