Job Description:
We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) to build and maintain scalable cloud-native data solutions.
Mandatory Skills:
Python, SQL, and PySpark
Google Cloud Platform (GCP)
BigQuery, Dataproc, Pub/Sub, and Cloud Composer (Apache Airflow)
Production-grade ETL/ELT pipelines
Batch and real-time streaming data processing
Data Warehousing, Data Modelling, Star & Snowflake Schemas, and SCD
Google Cloud Storage
Git/GitHub, CI/CD, and Code Reviews
Key Responsibilities:
Design and maintain scalable ETL/ELT pipelines using Python and PySpark.
Build and optimize cloud-native data solutions on GCP.
Develop SQL queries and data transformations in BigQuery.
Manage workflow orchestration using Cloud Composer.
Develop and troubleshoot Spark applications on Dataproc.
Build event-driven data ingestion pipelines using Pub/Sub.
Implement batch and real-time data processing solutions.
Ensure data quality, monitoring, and pipeline performance.
Good to Have:
Google Dataflow, Apache Beam, Bigtable, Cloud Spanner, and AlloyDB
dbt, Apache Spark, Hadoop, and Scala
Docker and data governance
Enterprise-scale cloud migration experience
GitHub Copilot and AI-assisted development tools
Interested candidates can share their updated CV at: yathkardesh.s@intellect-minds.com
Subject Line: Data Engineer – GCP
WhatsApp Channel: https://whatsapp.com/channel/0029VbCX74tBFLgdSccXch1A
YouTube Channel: https://youtube.com/@intellectminds6703?si=nQL6X5KVYy3Hv3W9
To apply for this job email your details to yathkardesh.s@intellect-minds.com