15 Job openings found

Role: Lead the design, development, and optimization of data pipelines and data platform components for an e-commerce business. Work across ingestion, transformation, modeling, governance, and performance to support large-scale Data & AI use cases. Key Responsibilities Build and maintain scalable batch and streaming data pipelines from transactional systems, clickstream, and third-party sources. Implement ...

Location: Ahmedabad Role: Build, optimize, and maintain data pipelines and data platform components to support analytics and AI use cases for an e-commerce business. Key Responsibilities Develop and maintain batch & streaming data pipelines from transactional, clickstream, and third-party sources. Work on data lake / lakehouse / warehouse environments across cloud platforms (e.g., ...

•         Experience in advanced Apache Spark processing framework, spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting. •         Experience in working with Core Spark, Spark Streaming, Data Frame API, Data set API, RDD APIs & Spark SQL programming dealing ...

We are having an urgent opening for a reputed company for the designation of Data Engineer for the Mumbai location. Responsibilities: Collect and process data Maintain existing ETL programs to ingest data from AWS, HDFS, SQL, and MySQL Implement API from existing sources Design and adapt ETL tools for new data sources, including streaming data Develop API for ...

    Notice period  Immediate to 15 days Shift  1 pm to 9 PM Mode of Work  Hybrid Mandatory Skill combination: Mandatory skill Kafka, Multiple Kafka connector, Streaming Data processing. In some cases, Databricks and PySpark knowledge is required. JD: Hands-on experience working on Kafka connect using schema registry in a very high-volume environment. Complete understanding of Kafka config properties (acks, timeouts, buffering, ...

CSB BankRole : Data EngineerData & AnalyticsLocation - Thane, Maharashtra, India (Mumbai Turbhe Office )Full-time RoleJob Description1. Data Engineer role is to design, build, and maintain scalable, reliable, and efficient data infrastructure that enables real-time and batch data processing across cloud and on-premise environments.2. This role ensures that high-quality, well-structured ...

Designation: Azure Cloud Application Engineer  Job Location: Bangalore(Hybrid) Experience: 5+ Years     Job Description Design and implement highly available and scalable Azure cloud data solutions that meet business requirements. Collaborate with cross-functional teams to design and implement solutions that meet business requirements. Participates in the testing process through test review and analysis. Developing and maintaining cloud applications, data lake and ...

Utilize Azure data services and frameworks such as Azure Data Factory, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, and Azure Databricks. Integrate, transform, and consolidate data from structured, unstructured, and streaming data systems into suitable schemas for building analytics solutions. Proficiency in SQL and Python Understanding of database management systems. Knowledge ...

Location - Remote   Position: Senior Data Warehouse BI Engineer (Snowflake & AWS Analytics)Experience Level: 8–12 years Required Skills & Experience: 8–12 years of hands-on experience in data engineering and analytics Strong expertise in Snowflake Data Warehouse including migrations, multi-tenancy, and performance tuning Advanced SQL development skills with a solid understanding of data modeling and warehousing concepts (Kimball, Data Vault, Star/Snowflake schemas) Proven ...

Data Engineer   Job Description: - Having experience in Analysis, Design, Development, Testing, Customisation, Bug fixes, Enhancement, Support and Implementation using Python, spark programming. - Worked on AWS environments such as lambda, server-less applications, EMR, Athena, Glue, IAM policies, roles, S3,CFT and Ec2. - Developed Python and Pyspark programs for data analysis. ...