Cloudera & Spark Developer

Job Description:

Responsibilities

Roles And Responsibilities Of Cloudera & Spark Developer

Secure data management and portable cloud-native data analytics delivered in an open, hybrid data platform. Whether you're powering business-critical AI applications or real-time analytics at scale, Cloudera Data Platform enables your business to do anything with your data, anywhere, securely.

What is Cloudera Enterprise? Enterprise Platform for Big Data. Cloudera Enterprise includes CDH, the world’s most popular open source Hadoop-based platform, as well as advanced system management and data management tools plus dedicated support and community advocacy from our world-class team of Hadoop developers and experts.

Responsibilities -

• Over all 6 to 10 years of experience with Data Management, Big Data, Data Warehousing and Analytics
• At least 3 to 6 years of experience in developing and Implementing Big Data Solutions
• At least 5 years of hands-on experience with Cloudera implementation of Hadoop Technologies such as Map Reduce,Spark
• 4 years of experience in building high performance ETL/ELT jobs using spark framework

• Strong experience working with high velocity and high volume data, including good experience in handling relational, semi-structured, and unstructured data (Mandatory to have Big data experience)

• Experiencing in Injecting the data into Hadoop cluster from external sources such as Oracle, SQL etc.
• Strong Python with Pyspark experience is MUST
• Should be able to demonstrate work experience in hive/Impala and Spark, PySpark.
• Familiar with framework-based data ingestion and engineering
• Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines
• Strong client-facing communication and facilitation skills
• Hadoop focused developer with focus on BI and data analysis
• Strong spark hands on skill a must. Very Strong SQL skills.
• Working knowledge of shell scripting and bash
• Working experience in AWS platform and familiar with s3, Redshift is desirable 
• Good knowledge of Hadoop Cluster Architecture and hands-on experience within Cloudera Hadoop ecosystems

Soft Skills -

• Willing to work supporting USA Timezone / overlap USA timezone
• Excellent communication and collaboration skills
• Excellent interpersonal skills and the ability to work in a team environment
• Strong communication skills in English, both written and spoken
• Strong in Agile-Development
• Strong analytical and troubleshooting skills