IGI/ Data Scientist/ BKC

Job Description:

Job Title: Data Engineer

Location: Mumbai

Experience: 1-3 years

Employment Type: Full-Time

About the Role

We are looking for a highly motivated Data Engineer to join our technology team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data infrastructure to support business intelligence, analytics, and AI-driven initiatives.

A key responsibility of this role is to leverage Data Engineering and Artificial Intelligence technologies to support the automation of the diamond grading process. The candidate will work closely with business stakeholders, gemologists, and technology teams to build intelligent data solutions that improve grading accuracy, operational efficiency, and decision-making.

Key Responsibilities

* Design, build, and maintain scalable ETL/ELT data pipelines.
* Develop and optimise data workflows for collecting, transforming, and loading data from multiple sources.
* Ensure high data quality, integrity, and consistency across enterprise systems.
* Build and maintain data warehouses, data lakes, and reporting datasets.
* Collaborate with business stakeholders, gemologists, and engineering teams to understand data requirements and deliver scalable solutions.
* Leverage Data Engineering and AI technologies to automate and enhance the diamond grading and certification process.
* Develop data pipelines and AI-ready datasets to support machine learning and Generative AI applications.
* Integrate AI models and Large Language Models (LLMs) into existing business workflows wherever applicable.
* Optimise SQL queries and improve overall data processing performance.
* Monitor, troubleshoot, and maintain production data pipelines.
* Implement data validation, logging, monitoring, and governance processes.
* Support AI initiatives by preparing datasets, integrating AI services, and enabling intelligent automation across grading operations.

Required Skills

* Strong proficiency in Python and SQL.
* Experience with ETL/ELT development.
* Hands-on experience with Apache Spark or PySpark.
* Experience with Databricks or similar big data platforms.
* Knowledge of relational databases such as SQL Server, PostgreSQL, or MySQL.
* Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
* Familiarity with orchestration tools such as Apache Airflow or Azure Data Factory.
* Strong understanding of data warehousing concepts and data modelling.

Preferred Skills

* Exposure to Generative AI and Large Language Models (LLMs).
* Experience using OpenAI, Azure OpenAI, Gemini, Claude, or similar AI platforms.
* Knowledge of LangChain, Retrieval-Augmented Generation (RAG), embeddings, and vector databases.
* Experience integrating AI models into production applications.
* Understanding of REST APIs and system integrations.
* Interest in applying AI to computer vision, image analysis, or process automation is an added advantage.

Qualifications

* Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
* 1–3 years of experience in Data Engineering or related roles.

Preferred Candidate Profile

* Strong analytical and problem-solving skills.
* Ability to work with cross-functional teams, including technology and business stakeholders.
* Passion for Data Engineering, AI, and automation.
* Eagerness to build innovative solutions that improve operational efficiency and transform traditional business processes.
* Ability to learn domain-specific workflows, particularly within the diamond grading and certification industry.