Position title
Spark/Scala/ Python Developer
Roles and Responsibilitie
- Work as part of a scrum team and provide big data ETL solutions for within an agile methodology.
- Participate in technical design discussions aiming for optimal performance and risk mitigation.
- Ensure code adheres to enterprise standards and principles.
- Leverage development operations techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Git, Bit Bucket.
- Work independently and drive solutions end-to-end leveraging various big data technologies to solve data problems and develop innovative big data solutions
Experience
- At least 6 years of overall experience developing software solutions.
- At least 4 years of experience in Service Oriented Architecture/Service integration with Web Services, REST and security integration.
- At least 3 years of experience of Scala + Spark in big data environments.
- At least 2 years of experience in working, defining, maintaining architectural frameworks, patterns and data structures.
- Proven experience in building in data driven applications using a combination of Java/Scala and the Spark framework.
- Proficient at scripting languages such as JavaScript, jQuery, JSON and other front-end scripting languages.
- Must have knowledge in building applications with concurrency.
- Experience in building front-end application using JavaScript, Angular JS, JSON, jQuery.Must have knowledge of latest Angular, Spring Component and Spring Boot Framework.
- Proven expertise w/leveraging big data components (including but not limited to,Hive, HBASE, Oozie, Kafka) to build large scale data processing systems.
- Proven experience in two or more of the programming languages (Java, Spark, Python).
- Experience working in an agile environment.
