Pyspark DocumentDB updates Kafka topics Data streaming
Budget: $2 – $8 USD
Need a strong streaming experience person to develop design deploy Pyspark publishing and upserting job in EMR with
Spark, MongoDB(documentDb) connector, AWS EMR step functions, Cloud watch, docker, Kafka cluster architecture, Airflow dags, Gitlab, Pycharm, Cursor AI IDE etc needed for environment experience
Spark, MongoDB(documentDb) connector, AWS EMR step functions, Cloud watch, docker, Kafka cluster architecture, Airflow dags, Gitlab, Pycharm, Cursor AI IDE etc needed for environment experience
Related categories:
Python
Data Processing
Amazon Web Services
Docker
GitLab
MongoDB
Data Integration
PySpark
Apache Kafka
Big Data