Data QA Engineer (Hybrid WFH)

• Testing Tools: Experience with Great Expectations, pytest, dbt test, or custom SQL/Python test frameworks.
• Databases: Hands-on experience with Relational (PostgreSQL, MySQL) and NoSQL (DynamoDB) databases.

JOB RESPONSIBILITIES

We are seeking a Data QA Engineer to design and execute test strategies across our AWS-based cloud data platforms and other platforms. You will validate complex ETL/ELT pipelines, ensure data integrity across data lakes and warehouses, and build automated testing frameworks for large-scale datasets.

• Pipeline Validation: Design and execute end-to-end data testing strategies for batch and streaming pipelines using AWS Glue, EMR
• Data Quality Assurance: Verify data accuracy, completeness, schema drift, and transformation logic between raw sources (S3) and destination analytical stores (Redshift, DynamoDB).
• Querying & Analytics: Write complex SQL scripts and PySpark jobs to perform data reconciliation, checksum validations, and boundary testing.
• CI/CD Integration: Integrate automated data test suites into AWS CodePipeline or GitHub Actions for continuous testing in deployment pipelines.
• Defect Tracking: Identify, log, and monitor data anomalies using tools like Jira, collaborating directly with Data Engineers and Analytics teams.
• Automation: Build and maintain automated data testing suites using Python, PyTest, and frameworks like Great Expectations or AWS Deequ. (Optional, nice to have).

• Work location: Makati City
• Work schedule: Monday to Friday/Morning shift
• Work set-up: Hybrid remote (2x a month onsite)
• Pay: Php50,000.00 - Php60,000.00 per month

Benefits

• Health insurance

Education

• Bachelor's (Required)

Experience

• Data Quality Engineering, Data Testing, or Data Engineering: 3 years (Required)
• Advanced SQL (window functions, aggregations): 3 years (Required)
• Python (Pandas, PySpark) : 3 years (Required)
• Database (PostgreSQL, MySQL) and NoSQL (DynamoDB): 3 years (Required)

Work Location: Hybrid remote in Makati