Event Streaming & Analytics Stack (Redpanda + ClickHouse + Metabase + Prestashop)

We are building a modern event-driven analytics pipeline to track and analyze data from our e-commerce system (PrestaShop).
We need a freelance data engineer to set up the foundation of this stack:

- Redpanda (Kafka-compatible) → event streaming layer
- ClickHouse → fast OLAP storage and query engine
- Metabase → BI / dashboard layer for business users

Deliverables :

Redpanda Setup
- Install and configure Redpanda (Docker, GCP VM later).
- Define and document best practices for topics, schemas, partitions.
- Implement schema validation (Avro/JSON schema registry).
- Setup basic monitoring (e.g., Grafana/Prometheus or Redpanda Console).

ClickHouse Setup
- Deploy and configure ClickHouse for ingestion from Redpanda.
- Create ingestion pipelines (Kafka → ClickHouse).
- Define example tables for key events (order created, product updated, cart events).
- Optimize schema for analytics (denormalized structure, partitions).

Metabase Integration
- Connect Metabase to ClickHouse.
- Build sample dashboards (orders over time, product views, sales by status, etc.).
- Provide documentation for creating new dashboards.

Documentation & Handover
- Clear instructions for local dev (Docker Compose) and production deployment (GCP VM).
- Diagrams of the data flow.
- How to add new topics/events and expose them in ClickHouse/Metabase.

Skills Required
- Docker and Git
- Strong knowledge of Kafka/Redpanda event streaming.
- Experience with ClickHouse and OLAP data modeling.
- Experience with Metabase (or other BI tools).
- Good documentation skills.