Apache Spark

Job Description:

Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements.                                                                                                                                                                                                                                                                                                                                                                                                                                                Must have Skills : Apache Spark  Good to Have Skills :  Microsoft SQL Server,Unix to Linux Migration,Data Warehouse ETL Testing,Amazon Web Service  Job Requirements :    Key Responsibilities :   A:Should be conversant with Apache Spark architecture, RDDs, various transformations and actions, spark configuration and tuning techniques B:Knowledge of Hadoop architecture; execution engines, frameworks, applications tools  C:Pyspark using Spark MLlib library  D:Exposure to Data warehousing concepts methods    Technical Experience :   A:Should have Excellent development experience with Python producing data applications  B:Should have 8 years of experience using PySpark with Spark RDDs Spark SQL DataFrames  C:Should have Experience in AWS Sagemaker and AWS Glue  D: Should have Experience in data wrangling and data analysis with Pandas and Numpy  E:Should have 3 years of Working experience with ML algorithms like Random Forest, Linear Regression, Logistic Regression, Decision Trees, K Means etc    Professional Attributes :   A: Should have good communication and analytical skills    Educational Qualification :       Additional Information :   A: Should have good communication and analytical skills