Senior Data Engineer, Data Infrastructure

Responsibilities

• Build and maintain scalable, reliable, and high-performance data infrastructure across cloud and on-prem environments
• Partner with engineering, analytics, and observability teams to support data flow from ingestion to consumption
• Develop infrastructure as code and automation tools to improve deployment, monitoring, and recovery
• Help troubleshoot performance bottlenecks and reliability issues in large-scale data pipelines
• Implement data quality processes aligned with security standards to ensure accuracy, consistency, and compliance with financial regulations and PCI requirements.
• Continuously improve the performance and efficiency of the data platform with proactive tuning and benchmarking
• Proactively explore and apply AI tools to enhance efficiency across the data engineering lifecycle, while improving accessibility and usability of data solutions for teams across the organization

Qualifications

• 7+ years of experience in data engineering, infrastructure, or DevOps roles
• Strong hands-on experience with message queue systems such as

Apache Kafka, Confluent and RabbitMQ

• Practical experience with the Elastic Stack (Elasticsearch, Logstash, Kibana), including designing data pipelines, index management, performance and costs optimization.
• Hands-on experience with time series databases such as Prometheus and InfluxDB
• Experienced with visualization and observability platforms including Grafana, Prometheus, Elastic stack. Designed and maintained interactive dashboards for real-time monitoring of system metrics, logs, and traces, enabling proactive issue detection and improved operational efficiency
• Strong knowledge of cloud platforms (AWS, GCP, or Azure) and operating production data infrastructure, ensuring scalability, reliability, and performance of data systems.
• Infrastructure as code experience using Terraform or Ansible

Proven proficiency in CI/CD methodologies with the ability to design and implement automated pipelines from scratch

• Responsible for organization-wide monitoring systems, with deep familiarity and understanding of the various infrastructure components, services, and devices across the organization
• Background in observability and performance tuning at scale
• Passion for automation, performance, and clean system design

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.