Lead Data Engineer

You’ll lead a team that owns the AI self-service portal and the related set of microservices. You’ll work with a cross-functional team of engineers to contribute to our data platform.  The role also offers the opportunity to grow into either more back-end or ML/AI work depending on your interests and experience.

In this role, you can expect to

• ·       Work directly with product owners and data experts to build products that solve to solve complex client problems
• ·       Build and support a distributed platform supporting all ExParte data
• ·       Work across our product, primarily on the data pipelines
• ·       Interface directly with internal teams
• ·       Evaluate software and implementation options and document them for technical teams
• ·       Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
• ·       Integrate best qualitative practices in program design and development.
• ·       Be a part of a distributed team (we’re in North America and Europe)
• ·       Work with Azure cloud and Databricks
• ·       Develop technical architectures and specific implementations to meet business needs.
• ·       Guide the team’s software engineering best practices by documenting standards and completing code reviews.
• ·       Troubleshoot new and existing code and provide feedback and solutions to structural issues in the codebase as they arise.
• ·       Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements.

Requirements

• ·       3+ years experience with RDBMS and T-SQL.
• ·       3+ years experience with NoSQL and DataLakes.
• ·       3+ Knowledge of Spark, Python, or Scala
• ·       Strong familiarity with map/reduce programming models
• ·       Proficiency in writing production-quality code
• ·       Deep expertise in database schema design, optimization, and scalability
• ·       Experience with Azure or AWS cloud-based service-oriented architecture
• ·       Solid understanding of testing pyramid (unit, integration, black box, service)
• ·       Experience working in an Agile/Scrum environment
• ·       Strong analytical and problem-solving skills
• ·       Good time management and organizational skills
• ·       Ability to work on challenging issues independently or in a team environment
• ·       Ability to learn and adapt quickly to new technologies and environments
• ·       Strong communication skills

Nice-to-have's

• ·       Experience with Databricks or Azure ML
• ·       Experience applying machine learning algorithms to solve complex data mining problems
• ·       Experience with BI tools
• ·       Understanding of cloud platforms and providers and DevOps
• ·       Bachelor's Degree in Computer Science, Engineering, Mathematics or related field
• All your information will be kept confidential according to EEO guidelines.