Senior GCP Data Engineer

Responsibilities:

Data Engineering & Architecture:
-
Design, develop, and maintain scalable data platforms and pipelines using Google Cloud services.
-
Implement data ingestion, transformation, and orchestration workflows using: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud SQL / PostgreSQL
-
Define data models, partitioning strategies, and storage architectures optimized for large-scale analytics.
-
Implement batch and near real-time data processing solutions.
BigQuery Engineering:
-
Design, optimize, and maintain BigQuery datasets, tables, views, and data marts.
-
Develop complex BigQuery SQL solutions for analytics and operational reporting.
-
Optimize query performance, storage costs, partitioning, clustering, and workload management.
-
Establish best practices for BigQuery governance, security, and performance monitoring.
PostgreSQL Engineering:
-
Design and develop PostgreSQL database solutions on GCP.
-
Create and optimize database schemas, indexes, stored procedures, and PL/pgSQL code.
-
Perform database performance tuning, capacity planning, and troubleshooting.
-
Support migration and modernization of legacy databases to PostgreSQL.
Cloud Migration & Modernization:
-
Support migration of legacy Oracle workloads to PostgreSQL and BigQuery.
-
Assess existing database architectures and recommend modernization approaches.
-
Collaborate with application teams to refactor data solutions for cloud-native environments.
-
Ensure data integrity, security, and operational readiness during migrations.
Data Governance & Security:
-
Implement IAM controls, encryption, auditing, and data protection standards.
-
Apply data governance and compliance requirements across the cloud platform.
Collaboration:
-
Participate in architecture reviews, code reviews, and engineering standards definition.
-
Collaborate with product owners, architects, analysts, and platform teams to deliver business value.
Skills
Must have:
-
Minimum 5 years of hands-on experience working with relational and analytical databases
-
Minimum 1 year of hands-on experience with Google BigQuery (GCP)
-
Proven expertise in Google BigQuery (GCP), with the ability to build, manage, and optimize data solutions in a cloud environment.
-
Proven expertise in PostgreSQL administration and development, including schema design, data integrity, performance monitoring, and troubleshooting.
-
Proficiency with GitHub for version control and collaborative development.
Nice to have:
-
Experience migrating Oracle databases to PostgreSQL and/or BigQuery.
-
Oracle SQL and PL/SQL knowledge.
-
Experience with Ora2pg or similar migration tooling.
-
Google Cloud Professional Data Engineer certification.
-
Google Cloud Professional Cloud Architect certification.
-
Experience with Terraform.
-
Experience with containerized deployments using Docker and Kubernetes (GKE).
-
Experience with Airflow / Cloud Composer.
-
Experience with data governance, metadata management, and data quality frameworks.
-
Experience with Google Cloud Dataflow for building and managing data processing pipelines.
-
Experience with Google Cloud Dataproc for big data processing and analytics workloads.
-
Experience with Google Cloud Pub/Sub for event-driven architectures and real-time data streaming.
-
Python for data engineering, automation, data processing, and scripting tasks.