Real-Time Data Engineering Solution -- 2

I’m looking for a freelancer to build a lightweight but robust real-time data engineering and dashboard system.

The system should:

Ingest streaming data (simulated or from external sources).

Connect to both on-premises storage and cloud platforms (e.g., Azure Data Lake or Blob Storage).

Prioritize real-time data processing to handle continuous streams efficiently.

Integrate with data warehouses such as Snowflake, BigQuery, or Redshift for scalable data management.

Provide dynamic, interactive visualizations using tools like Streamlit or Power BI.

Be responsive, reliable, and easy to deploy.

Deliverables:

Clean and documented code (Python preferred)

Database schema and pipeline setup

Real-time dashboard with auto-refresh

Deployment instructions

Budget: $30 – $250 USD (Micro Project)
Timeline: 5 – 7 days