Senior Software Engineer, Data Platform

Hiring for multiple roles.

Traditional forecasting breaks under petabytes of features, megabytes of labels, and time-varying noise. Our breakthrough research is foundational in the field: generating industry-beating results ( MIT News ). Our predictive engines combine a wide variety of data through rigorous scientific process. We leverage alternative datasets (consumer transactions, geolocation, etc) along with private, public, external, and internal data.

The Data Platform is a critical component in our scientific approach to forecasting. The role will require everything from high-level architecture design to performant implementation.

Responsibilities include

• Build distributed systems supporting complex transformations over petabyte-scale data
• Design, implement, and maintain production cloud data pipelines for complex, disparate datasets
• Work closely with our Quants and Applied Scientists to support rigorous scientific process, rapid experimentation, and new product initiatives

Required qualifications

• Bachelor’s or advanced degree in Computer Science, math or equivalent
• 3+ years of experience in data engineering or related fields with a track record of building (coding) and scaling a data platform
• 2+ years of industry experience building ETL pipelines in a major cloud provider
• Highly proficient in python and SQL
• Advanced knowledge of databases, design patterns, OOP, and concurrency
• Knowledge of data management fundamentals and data storage principles
• Passion for intuitive data models
• Experience communicating with senior management as well as colleagues from engineering, analytics, and business backgrounds
• Experience with AWS, orchestration platforms, and modern tech stacks
• Strong software engineering fundamentals: system design, algorithms, data structures

Nice-to-haves

• Experience building systems that integrate LLMs with large-scale data processing
• Working understanding of basic probability and statistics
• Experience implementing ML models
• Experience with DBT
• MS or PhD in STEM field

In-person at our NYC office strongly preferred. Remote candidates who can spend some time in-office (e.g., monthly) will also be considered.

Benefits

• The salary range for this position is $145,000-$220,000
• Free health, vision, dental insurance
• 401k with match
• Unlimited PTO + 13 company holidays
• Daily Grubhub lunch stipend
• Pre-tax commuter benefits