TECHNOLOGY CONSULTANT - AWS SPARK

Job Description:

Skills Required: Python + AWS/Airflow (Candidate should be very good in Python) Spark, SQL.

Experience: 3-8 years

Salary: 8 to 20 LPA

Location: Bangalore

No. of positions: 4 (2 SSE, 2 TC)

Job Description

Role requires experience in AWS and also programming experience in Python, SQL, Airflow and AWS.

• Translate functional requirements into technical design
• Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core cloud services needed to fulfil the technical design
• Design, Develop and Deliver data integration interfaces in the AWS
• Design, Develop and Deliver data provisioning interfaces to fulfil consumption needs
• Deliver data models on Cloud platform, it could be on AWS Redshift, SQL.
• Design, Develop and Deliver data integration interfaces at scale using Python / Spark
• Automate core activities to minimize the delivery lead times and improve the overall quality
• Optimize platform cost by selecting right platform services and architecting the solution in a cost-effective manner
• Manage code and deploy DevOps and CI CD processes
• Deploy logging and monitoring across the different integration points for critical alerts

Experience Required:

• Minimum 4 years of software development experience
• Bachelor's and/or Master’s degree in computer science
• Strong Consulting skills in data management including data governance, data quality, security, data integration, processing and provisioning
• Delivered data management projects in any of the AWS
• Translated complex analytical requirements into technical design including data models, ETLs and Dashboards / Reports
• Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases
• Experience with different computing paradigms in databases such as In-Memory, Distributed, Massively Parallel Processing