Senior Data Engineer

About the role

We are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate with cross-functional teams to gather requirements, build scalable solutions, and ensure the availability and reliability of our data systems.

Responsibilities

• ●Design, develop, and implement scalable and efficient data pipelines in the cloud using Python, SQL, and relevant technologies.
• ● Build and maintain data infrastructure on platforms such as AWS, leveraging services like EMR, Redshift, and others.
• ● Collaborate with data scientists, analysts, and other stakeholders to understand their requirements and provide the necessary data solutions.
• ● Develop and optimize ETL (Extract, Transform, Load) processes to ensure the accuracy, completeness, and timeliness of data.
• ● Create and maintain data models, schemas, and database structures using PostgreSQL and other relevant database technologies.
• ● Experience reporting tools such as Superset, (good to have : Domo, or Tableau, Quicksight) to develop visually appealing and insightful data visualizations and dashboards.
• ● Monitor and optimize the performance and scalability of data systems, ensuring high availability and reliability.
• ● Implement and maintain data security and privacy measures to protect sensitive information.
• ● Collaborate with the engineering team to integrate data solutions into existing applications or build new applications as required.
• ● Stay up-to-date with industry trends, emerging technologies, and best practices in data engineering

Qualifications

• ● Bachelor's or master's degree in Computer Science, Engineering, or a related field.
• ● Strong proficiency in Python and SQL for data manipulation, analysis, and scripting.
• ● Extensive experience with cloud platforms, particularly AWS, and working knowledge of services like EMR, Redshift, and S3.
• ● Solid understanding of data warehousing concepts and experience with relational databases like PostgreSQL.
• ● Familiarity with data visualization and reporting tools such as Superset, Domo, or Tableau.
• ● Experience with building and maintaining data pipelines using tools like Airflow.
• ● Knowledge of Python web frameworks like Flask or Django for building data-driven applications.
• ● Strong problem-solving and analytical skills, with a keen attention to detail.
• ● Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• ● Proven ability to work in a fast-paced environment, prioritize tasks, and meet deadlines.
• ● If you are a talented Data Engineer with a passion for leveraging data to drive insights and impact, we would love to hear from you.