Big Data Engineer for Flexible Energy Solutions - Sydney timezone
Budget: $25 – $50 AUD
We are working on a project for a leading provider of demand response (DR) and flexible energy solutions, and the Big Data Software Engineer will help building the next generation data services and analytics platform.
A Big Data Engineer on the Data Platform team is ideally a strong generalist with experience using SQL & NoSQL solutions, who is capable of solving scalability puzzles, working with large data sets and has the drive necessary to optimize performance of high-visibility smart grid systems.
Key Responsibilities:
• Work with the platform team to identify, evaluate and implement SQL&NoSQL storage solutions
• Design strategies for storing structured and unstructured data
• Write code in a variety of languages
• Assist in architecting and deliver software components
• Author and maintain technical specifications
Required Qualifications:
• 3+ Experience implementing solutions built on NoSQL database technologies systems (HBase, Hadoop, DynamoDB , MongoDB, etc…)
• 5+ years professional experience designing and developing Java applications;
• 3+ years of experience developing and working on big data platforms leveraging services like Dynamo, Redshift, Lambda , Kinesis and EMR
• Experience working with large data sets.
• Experience working with real-time data.
• Big Data concepts such as map reduce,
• Deep understanding of one (or more) of the following languages: JAVA, Scala, NodeJS and Python
• Experience implementing and using RESTful APIs
• Experience with source control, build systems, and testing tools.
• Excellent communication and collaboration skills
• Ability to work from our Boston office
Desired Qualifications:
• Experience with a big data database management system (e.g. Cassandra, HBase)
• Experience running and administering applications on Amazon Web Services
• Experience working with Amazon Web Services (AWS) and cloud management tools;
• Prior experience building ETL systems
• Experience with Spark and R
• Experience working in an agile environment (Scrum, Kanban, etc.)
The role is fully remote but requires to work on Sydney timezone.
A Big Data Engineer on the Data Platform team is ideally a strong generalist with experience using SQL & NoSQL solutions, who is capable of solving scalability puzzles, working with large data sets and has the drive necessary to optimize performance of high-visibility smart grid systems.
Key Responsibilities:
• Work with the platform team to identify, evaluate and implement SQL&NoSQL storage solutions
• Design strategies for storing structured and unstructured data
• Write code in a variety of languages
• Assist in architecting and deliver software components
• Author and maintain technical specifications
Required Qualifications:
• 3+ Experience implementing solutions built on NoSQL database technologies systems (HBase, Hadoop, DynamoDB , MongoDB, etc…)
• 5+ years professional experience designing and developing Java applications;
• 3+ years of experience developing and working on big data platforms leveraging services like Dynamo, Redshift, Lambda , Kinesis and EMR
• Experience working with large data sets.
• Experience working with real-time data.
• Big Data concepts such as map reduce,
• Deep understanding of one (or more) of the following languages: JAVA, Scala, NodeJS and Python
• Experience implementing and using RESTful APIs
• Experience with source control, build systems, and testing tools.
• Excellent communication and collaboration skills
• Ability to work from our Boston office
Desired Qualifications:
• Experience with a big data database management system (e.g. Cassandra, HBase)
• Experience running and administering applications on Amazon Web Services
• Experience working with Amazon Web Services (AWS) and cloud management tools;
• Prior experience building ETL systems
• Experience with Spark and R
• Experience working in an agile environment (Scrum, Kanban, etc.)
The role is fully remote but requires to work on Sydney timezone.