Software Engineer (Distributed Data Systems)

Join our team as a Software Engineer specializing in Distributed Data Systems. In this role, you will design and implement new concurrency control and transactional capabilities, develop optimized indexing schemes, and create systems to streamline metadata and data access. You will also solve complex optimization problems to improve the efficiency of distributed data processing algorithms. This position offers a remote-friendly work environment, competitive compensation, and a comprehensive benefits package.

• Design and implement new concurrency control and transactional capabilities to maximize throughput for competing writers.
• Collaborate with other engineers to implement and deploy optimized solutions in production, ensuring safe rollout.
• Solve hard optimization problems to improve the efficiency of distributed data processing algorithms over a Kubernetes cluster.

• Experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases
• An ability to solve complex programming/optimization problems
• Robust and clear communication skills
• An ability to prioritize across feature development and tech debt with urgency and speed
• An ability to quickly prototype optimization solutions and analyze large/complex data
• Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform)
• You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions
• Experience in optimization mathematics (linear programming, nonlinear optimization)
• Experience working with database systems, Query Engines or Spark codebases
• Existing publications of optimizing large-scale data systems in top-tier distributed system conferences
• PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects