Data Engineer

Job Description:

Job Title: Data Engineer

Experience: 1.5 to 2 Years

Location: Shyaml cross road, Ahmedabad

Employment Type: Full-time

Job Description:

We are looking for a Data Engineer with 1.5 to 2 years of experience who has expertise in Python and data scraping. The ideal candidate will be responsible for building and optimizing data pipelines, extracting and processing data from various sources, and ensuring data integrity.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Python.
• Perform data scraping from websites, APIs, and other sources.
• Optimize data extraction, transformation, and loading (ETL) processes.
• Ensure data accuracy, integrity, and security.
• Work with large datasets and clean, preprocess, and transform data as needed.
• Automate data collection and storage for analytics and reporting purposes.
• Collaborate with cross-functional teams, including data analysts and software engineers.

Required Skills & Qualifications:

• 1.5 to 2 years of experience in data engineering or a related role.
• Strong proficiency in Python and experience with libraries like Scrapy, BeautifulSoup, Selenium, or Requests for web scraping.
• Knowledge of data extraction, transformation, and storage techniques.
• Experience with databases (SQL & NoSQL) such as MySQL, PostgreSQL, or MongoDB.
• Familiarity with cloud services (AWS, GCP, or Azure) is a plus.
• Basic understanding of big data technologies (Spark, Hadoop) is an advantage.
• Good problem-solving skills and attention to detail.

Preferred Skills (Good to Have):

• Experience with API integration and handling JSON/XML data.
• Knowledge of data visualization tools like Power BI, Tableau, or Matplotlib.
• Exposure to workflow automation tools like Apache Airflow or Prefect.