Data Engineer - GCH

1. Data Engineer:

Core Skills and Knowledge

• 5-8 years of experience in data engineering.
• Hands-on experience with Databricks (Delta Lake, notebooks, Databricks Workflows).
• Strong programming skills in Python and SQL.
• Working knowledge of Apache Spark (PySpark preferred) for data transformation.
• Experience with either AWS (S3, Glue, EMR) or Azure (ADLS Gen2, Data Factory, Synapse) services.
• Understanding of data modeling concepts (star schema, dimensional modeling).
• Familiarity with version control (Git) and basic CI/CD practices.

Desirable Skills

• Databricks Certified Data Engineer Associate (or working toward it).
• Exposure to streaming data pipelines (Structured Streaming, Kafka, Kinesis, or Event Hubs).
• Familiarity with orchestration tools (Airflow, Databricks Workflows).
• Basic understanding of data governance and security practices (PII masking, access control).
• Exposure to Power BI or other BI tools for understanding downstream