Snowflake Data Architect for Epiko Hub
Budget: ₹1,500 – ₹12,500 INR
We are looking for an experienced Snowflake Data Architect/Engineer to integrate and architect Snowflake as the central data platform for our Epiko Hub project. Epiko Hub is a comprehensive ecosystem unifying gaming, NFTs, phygital assets, and social features, serving both Web2 and Web3 users. The successful candidate will design, implement, and optimize data pipelines, storage, and processing workflows using Snowflake’s advanced capabilities.
Key Responsibilities:
Architectural Planning:
Design a scalable, secure, and efficient data architecture with Snowflake as the core repository.
Develop detailed technical documentation outlining integration points and data flows across Epiko Hub modules.
Data Ingestion & Processing:
Set up and configure Snowpipe for real-time data ingestion from game servers, blockchain APIs, and external marketplaces.
Develop and optimize ETL pipelines using Snowpark for processing streaming data and generating live analytics.
Implement data storage strategies using Hybrid Tables for both real-time and historical data.
Analytics and AI Integration:
Integrate Snowflake Cortex to enable AI/ML models for personalized insights, churn prediction, and reward optimization.
Ensure processed data feeds into real-time dashboards, leaderboards, and user engagement tools.
Scalability & Security:
Configure multi-cluster warehouses to support high-concurrency scenarios, especially during peak events (e.g., tournaments, NFT drops).
Implement Snowflake’s Secure Data Sharing for controlled access and collaboration with partners.
Utilize Snowflake’s Time Travel feature for data auditing, recovery, and compliance.
Collaboration and Documentation:
Work closely with backend developers, blockchain specialists, and UI/UX teams to ensure seamless integration.
Document all architecture decisions, data models, workflows, and integration points for ongoing maintenance and future scalability.
Required Skillsets:
Snowflake Expertise:
Extensive experience with Snowflake’s platform including Snowpipe, Snowpark, Cortex, Hybrid Tables, Multi-Cluster Warehouses, and Time Travel.
Data Engineering & ETL:
Proficiency in building and managing ETL pipelines and processing real-time data streams.
Strong SQL skills and experience with scripting languages (e.g., Python) for data transformations.
Cloud Platform Experience:
Hands-on experience with AWS, Azure, or GCP environments.
Big Data & Analytics:
Familiarity with BI tools and data warehousing best practices.
Integration Skills:
Experience integrating data from diverse sources including REST APIs and blockchain data feeds.
Deliverables:
A comprehensive data architecture design document that details Snowflake integration and data flows.
Implemented and documented ETL pipelines using Snowpipe and Snowpark.
Configured and tested multi-cluster warehouse and secure data sharing settings.
Integration of AI/ML workflows using Snowflake Cortex, with a demonstration of real-time analytics.
Regular progress updates and collaborative sessions with our technical team.
The project should be completed within a timeframe of 4 weeks. Include mechanisms for processing user interaction and engagement data efficiently. The Snowflake Data Architect will work collaboratively with our AI/ML team to integrate Snowflake Cortex effectively. The primary goal for the integration of Snowflake is to enable real-time analytics and insights for Epiko Hub users. Our preferred cloud platform for this project is Azure. The expected volume of data to be processed is 1 GB. We expect daily progress updates for the duration of the project. The Epiko Hub project is currently in the development stage. Our preferred communication method for this project is MS Teams.
Key Responsibilities:
Architectural Planning:
Design a scalable, secure, and efficient data architecture with Snowflake as the core repository.
Develop detailed technical documentation outlining integration points and data flows across Epiko Hub modules.
Data Ingestion & Processing:
Set up and configure Snowpipe for real-time data ingestion from game servers, blockchain APIs, and external marketplaces.
Develop and optimize ETL pipelines using Snowpark for processing streaming data and generating live analytics.
Implement data storage strategies using Hybrid Tables for both real-time and historical data.
Analytics and AI Integration:
Integrate Snowflake Cortex to enable AI/ML models for personalized insights, churn prediction, and reward optimization.
Ensure processed data feeds into real-time dashboards, leaderboards, and user engagement tools.
Scalability & Security:
Configure multi-cluster warehouses to support high-concurrency scenarios, especially during peak events (e.g., tournaments, NFT drops).
Implement Snowflake’s Secure Data Sharing for controlled access and collaboration with partners.
Utilize Snowflake’s Time Travel feature for data auditing, recovery, and compliance.
Collaboration and Documentation:
Work closely with backend developers, blockchain specialists, and UI/UX teams to ensure seamless integration.
Document all architecture decisions, data models, workflows, and integration points for ongoing maintenance and future scalability.
Required Skillsets:
Snowflake Expertise:
Extensive experience with Snowflake’s platform including Snowpipe, Snowpark, Cortex, Hybrid Tables, Multi-Cluster Warehouses, and Time Travel.
Data Engineering & ETL:
Proficiency in building and managing ETL pipelines and processing real-time data streams.
Strong SQL skills and experience with scripting languages (e.g., Python) for data transformations.
Cloud Platform Experience:
Hands-on experience with AWS, Azure, or GCP environments.
Big Data & Analytics:
Familiarity with BI tools and data warehousing best practices.
Integration Skills:
Experience integrating data from diverse sources including REST APIs and blockchain data feeds.
Deliverables:
A comprehensive data architecture design document that details Snowflake integration and data flows.
Implemented and documented ETL pipelines using Snowpipe and Snowpark.
Configured and tested multi-cluster warehouse and secure data sharing settings.
Integration of AI/ML workflows using Snowflake Cortex, with a demonstration of real-time analytics.
Regular progress updates and collaborative sessions with our technical team.
The project should be completed within a timeframe of 4 weeks. Include mechanisms for processing user interaction and engagement data efficiently. The Snowflake Data Architect will work collaboratively with our AI/ML team to integrate Snowflake Cortex effectively. The primary goal for the integration of Snowflake is to enable real-time analytics and insights for Epiko Hub users. Our preferred cloud platform for this project is Azure. The expected volume of data to be processed is 1 GB. We expect daily progress updates for the duration of the project. The Epiko Hub project is currently in the development stage. Our preferred communication method for this project is MS Teams.