Apache Pulsar on IBM Cloud
Budget: $750 – $1,500 USD
About the project:
Explore the setup and configuration of a secure and highly available instance of Apache Pulsar (https://pulsar.apache.org/) on IBM Cloud (https://cloud.ibm.com/login). The overarching goal is to enable clients to build enterprise cloud applications using Pulsar.
Goals:
1. Start simple: Install and configure Apache Pulsar on IBM Cloud using a helm chart (https://pulsar.apache.org/docs/helm-install/) [access will be provided to the IKS cluster (https://www.ibm.com/cloud/free/kubernetes)], and using Red Hat operator [access will be provided to the Red Hat OpenShift on IBM Cloud cluster(https://www.ibm.com/cloud/openshift)]. Test with a simple producer/consumer.
2. Add message options: Configure message compression, batching, deduplication, etc. Test with a simple producer/consumer.
3. Add message security: Configure end-to-end Pulsar message encryption (https://pulsar.apache.org/docs/security-encryption/). Test with a simple producer/consumer.
4. Highly available region: Install and configure a three-zone regional Pulsar instance. Test with a simple producer/consumer.
5. Test that the region continues to operate when one or two zones are offline for maintenance or are down.
6. Multiple geographies: Install two additional geographies. Test the Pulsar geo-replication feature across zones and/or Geos. Test the system works when the entire geo is offline.
What skills are required:
Java programming, IBM Cloud Kubernetes Service, and Apache Kafka is considered but Pulsar install and config expertise is required
How would you like to get it done:
Contribute an article to Medium describing the experience. Code can be saved in an open-source repo.
Deliverables:
• Medium article
• Sample source code, configurations
Explore the setup and configuration of a secure and highly available instance of Apache Pulsar (https://pulsar.apache.org/) on IBM Cloud (https://cloud.ibm.com/login). The overarching goal is to enable clients to build enterprise cloud applications using Pulsar.
Goals:
1. Start simple: Install and configure Apache Pulsar on IBM Cloud using a helm chart (https://pulsar.apache.org/docs/helm-install/) [access will be provided to the IKS cluster (https://www.ibm.com/cloud/free/kubernetes)], and using Red Hat operator [access will be provided to the Red Hat OpenShift on IBM Cloud cluster(https://www.ibm.com/cloud/openshift)]. Test with a simple producer/consumer.
2. Add message options: Configure message compression, batching, deduplication, etc. Test with a simple producer/consumer.
3. Add message security: Configure end-to-end Pulsar message encryption (https://pulsar.apache.org/docs/security-encryption/). Test with a simple producer/consumer.
4. Highly available region: Install and configure a three-zone regional Pulsar instance. Test with a simple producer/consumer.
5. Test that the region continues to operate when one or two zones are offline for maintenance or are down.
6. Multiple geographies: Install two additional geographies. Test the Pulsar geo-replication feature across zones and/or Geos. Test the system works when the entire geo is offline.
What skills are required:
Java programming, IBM Cloud Kubernetes Service, and Apache Kafka is considered but Pulsar install and config expertise is required
How would you like to get it done:
Contribute an article to Medium describing the experience. Code can be saved in an open-source repo.
Deliverables:
• Medium article
• Sample source code, configurations