Looking for Spark Lead for a Project with one of the leading Enterprise Client
Budget: ₹750 – ₹1,250 INR
Looking for INDIVIDUAL full-time freelancers for our Enterprise Client.
Project Duration: 12 months.
Remote/WFH
Position - Spark Lead
Job Description
In the role of Senior Developer, you will be a key developer and work alongside other developers in the team. You will develop software code as per specifications provided according to customer requirements. You will Interact with customers on need basis for requirements discussions and product demos. You will work in a cross functional scrum team along with Product owner and Testers to deliver software features in Agile methodology. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Role and Responsibilities :
Participate in discussions with customers to gather scope information and perform analysis of scope information to provide inputs for project scope documentation
Perform high and Low-level design, provides pseudo codes, Implements the prototypes, and does design reviews to deliver design documents as per customer requirements
Develop optimized high-quality code deliverables, contribute to continual knowledge management, and adhere to the organizational guidelines and processes.
Interface with the customer for issue resolution, provide status updates, Build customer confidence in team’s ability to deliver in order to support high customer satisfaction
Required
Very Good knowledge in Spark and Java Programming.
Java , Spring framework knowledge
Knowledge in Bigdata – Hadoop, Spark, Hive, Scoop.
Extensive knowledge in Spark Framework, Data Ingestion
RDD/Data Set /Data Frame/UDF
Yarn and resource prioritization
end to end use case of Data ingestion from source to the transformation, in memory processing, loading into big data store.
Multiple ways of processing large volume of data
Concepts of Hive, Scoop and Zookeeper
Scoop the data from the big data store for loading to the other data stored like RDBMS or file storage
Performance tuning of spark framework.
Managed tables & Hive external tables
Experience in Jenkins, InteliJ, Git
Work exposure in Agile projects. Good understanding of Agile ceremonies including tools like JIRA.
Thorough knowledge & understanding of Oracle DB.
Have experience in using/setting up DevOps , CI/CD pipeline
Strong Communication Skills and capability to deal with business & Global counterparts independently
Capable of analyzing Business requirements and building Functional requirements.
Should have at least 5+ years of industry experience.
Good analytical skills and data analysis capabilities.
Attitude to learn new technologies and working on new projects.
Highly Sensitive to Information Security and Data Privacy laws.
Decent Web Servers, Application Servers, Java knowledge
Flexible to handle adhoc requests / agile projects
This role requires flexibility to relocate within India and customer locations worldwide as required.
Preferred
Exposure to Snowflake, Nifi, Kafka,impala preferred
Please answer the following questions in the bid:
1. How many years of work experience do you have using Spark ?
2. How many years of work experience do you have using Spark and Java ?
3. How many years of experience do you have in Spark Framework ?
4. How many years of experience do you have in Jenkins ?
5. Will you be available full-time, M-F from 9 to 6 PM?
Project Duration: 12 months.
Remote/WFH
Position - Spark Lead
Job Description
In the role of Senior Developer, you will be a key developer and work alongside other developers in the team. You will develop software code as per specifications provided according to customer requirements. You will Interact with customers on need basis for requirements discussions and product demos. You will work in a cross functional scrum team along with Product owner and Testers to deliver software features in Agile methodology. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Role and Responsibilities :
Participate in discussions with customers to gather scope information and perform analysis of scope information to provide inputs for project scope documentation
Perform high and Low-level design, provides pseudo codes, Implements the prototypes, and does design reviews to deliver design documents as per customer requirements
Develop optimized high-quality code deliverables, contribute to continual knowledge management, and adhere to the organizational guidelines and processes.
Interface with the customer for issue resolution, provide status updates, Build customer confidence in team’s ability to deliver in order to support high customer satisfaction
Required
Very Good knowledge in Spark and Java Programming.
Java , Spring framework knowledge
Knowledge in Bigdata – Hadoop, Spark, Hive, Scoop.
Extensive knowledge in Spark Framework, Data Ingestion
RDD/Data Set /Data Frame/UDF
Yarn and resource prioritization
end to end use case of Data ingestion from source to the transformation, in memory processing, loading into big data store.
Multiple ways of processing large volume of data
Concepts of Hive, Scoop and Zookeeper
Scoop the data from the big data store for loading to the other data stored like RDBMS or file storage
Performance tuning of spark framework.
Managed tables & Hive external tables
Experience in Jenkins, InteliJ, Git
Work exposure in Agile projects. Good understanding of Agile ceremonies including tools like JIRA.
Thorough knowledge & understanding of Oracle DB.
Have experience in using/setting up DevOps , CI/CD pipeline
Strong Communication Skills and capability to deal with business & Global counterparts independently
Capable of analyzing Business requirements and building Functional requirements.
Should have at least 5+ years of industry experience.
Good analytical skills and data analysis capabilities.
Attitude to learn new technologies and working on new projects.
Highly Sensitive to Information Security and Data Privacy laws.
Decent Web Servers, Application Servers, Java knowledge
Flexible to handle adhoc requests / agile projects
This role requires flexibility to relocate within India and customer locations worldwide as required.
Preferred
Exposure to Snowflake, Nifi, Kafka,impala preferred
Please answer the following questions in the bid:
1. How many years of work experience do you have using Spark ?
2. How many years of work experience do you have using Spark and Java ?
3. How many years of experience do you have in Spark Framework ?
4. How many years of experience do you have in Jenkins ?
5. Will you be available full-time, M-F from 9 to 6 PM?