Azure Data Engineer

Azure Data Engineer

2 Nos.
68094
Full Time
5.0 Year(s) To 10.0 Year(s)
0.00 LPA TO 50.00 LPA
IT Software - Client Server
IT-Software/Software Services
Job Description:
Key Responsibilities
 
  • Design, construct, install, test, and maintain highly scalable and robust data management systems.
  •  Understand and apply data warehousing concepts to design and implement robust data warehouse tables in line with business requirements.
  •  Build complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.
  • Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc
  •  Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets, improve the performance, and enhance scalability of our data operations.
  •  Develop and implement Azure-based data architectures consistent across multiple projects while adhering to best practices and standards.
  • Lead initiatives for data integrity and normalization within Azure data storage and processing environments.
  • Evaluate and optimize Azure-based database systems for performance efficiency, reusability, reliability, and scalability.
  •  Troubleshoot complex data-related issues within Azure and provide expert guidance and support to the team.
  • Ensure all data processes adhere to governance, data security, and privacy regulations.
Required Qualifications:
 

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.
  • Expertise in Python, SQL, and deep understanding of PySpark.
  • Proficient in Databricks or similar big data solutions.
  • Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
  •  Proven experience in designing and deploying high-performance data processing systems on.
  • Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.
  • Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.
 
Key Skills :
Company Profile

Is a leading IT Solutions and Consulting Company

Apply Now

  • Interested candidates are requested to apply for this job.
  • Recruiters will evaluate your candidature and will get in touch with you.

Similar Jobs

Azure Data Engineer
Azure,Pyspark,Python