Sr. GCP Data Engineer

Job Description:

• Design, develop, and maintain scalable data pipelines and ETL processes to support various business needs. 
• Build and manage data workflows using the Databricks, GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services. 
• Implement data models and transformations using DBT (Data Build Tool) to support analytical requirements. 
• Collaborate with data analysts and scientists to understand and translate data needs into technical specifications. 
• Ensure data quality, integrity, and governance by implementing monitoring and alerting mechanisms, along with automated data validation processes. 
• Optimize and troubleshoot complex SQL queries and ETLjobs for performance and reliability. 
• Develop and maintain comprehensive documentation for data pipelines, ETL processes, and data models. 
• Stay up-to-date with the latest trends and technologies in data engineering, cloud computing, and analytics 

• Extensive experience with the GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services. 
• Proficiency in using DBT (Data Build Tool) for data transformation and modeling. 
• Strong SQL skills, with the ability to write complex queries and optimize them for performance. 
• Experience with data integration tools and frameworks (e.g., Apache Airflow, QIik, GCP) 
• Experience working with real-time data streaming and processing (e.g., Apache Kafka, Pub/Sub). 
• Certification in GCP (e.g., Google Professional Data Engineer) is a plus. 
• Experience in Agile/Scrum methodologies