Data Engineer

Job Description:

Data Engineer:
? Experience, in a backend engineer role, dealing with data intensive platforms.
? Fluency in Java, Scala, Python
? Exposure to Big Data systems like Hadoop, Map reduce/Spark
? Good understanding of Design Patterns and programming constructs
? Good comfort in working with agile CI/CD (Git) set up
? Experience with spring boot, Hibernate, Maven
? Experience utilizing JVM performance measurement tools and tuning approaches.
? Understanding of containerization, Swarms, ECS or similar deployment stack would be a
plus.
? Experience with both traditional(MYSQL/SQL Server) and distributed database(Hive/
Hbase).
? Must have strong experience in Spark Core / Optimization & Scala.
? Experience in Data modeling.
? Strong understanding integration of Kafka/Spark/SQL/Nifi.
? Experience with databases like SQL.
? Experience with performance/scalability tuning, algorithms, and computational complexity.
? Working knowledge of Kubernetes, Docker.
? Expertise in automated build, test & deploy.
? Good to have experience in Hive, Sqoop.
Keywords:
Hadoop, apache spark, EMR, EC2, Java/scala, Python, SQL, hive, Azure/ GCP/AWS.