Big Data Engineer - Lead
1 Nos.
28131
Full Time
7.0 Year(s) To 12.0 Year(s)
10.00 LPA TO 35.00 LPA
IT Software - System Programming
IT-Software/Software Services
Job Description:
• Experience in advanced Apache Spark processing framework, spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting.
• Experience in working with Core Spark, Spark Streaming, Data Frame API, Data set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data. Specifically, this experience must be in writing "Big Data" data engineering jobs for large scale data integration in AWS.
• Advanced SQL experience using Hive/Impala framework including SQL performance tuning
• Experience in writing spark streaming jobs integrating with streaming frameworks such as Apache Kafka or AWS Kinesis.
• Experience working in Key/Value data store such as HBase
• Experience in AWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud watch is required.
Key Skills :
Company Profile
It is one of the leading Indian MNC Firm whose service offerings are aligned to the changing world of their customers. Their portfolio of services range from designing strategy to delivering impact.
Apply Now
- Interested candidates are requested to apply for this job.
- Recruiters will evaluate your candidature and will get in touch with you.