Senior Software Engineer (Python) - Supply & Demand

Your future position

-

Lead the technical direction of generalising the S&D data model from crude oil to all commodities, owning the trade-offs between debt, design, reliability and time-to-market as the crew's call.

-

Evolve the shared ETL Framework (Reader → Transformer → Writer) in `supply-demand-core` into the reusable foundation every commodity vertical builds on, so LNG, grains and new products stop diverging into bespoke pipelines.

-

Own publication reliability end to end: the anomaly-detection guardrail (`supply-demand-ml`), the release path, and the data-quality bar that decides whether a balance is fit to ship to customers.

-

Set and raise the non-functional bar (reliability, latency, observability, security, cost) across the crew's Python engine, TypeScript data-distribution APIs and Airflow orchestration.

-

Shape the external + webapp data-distribution API contract (`supply-demand-oil-api`, `supply-demand-grains-api`) that external clients depend on: versioning, pagination, backward compatibility.

-

Lead design reviews within the crew and steward the crew's ADRs; bring engineering alignment to ambiguous, business-critical work.

-

Own the response to critical incidents in the crew's systems, and drive the preventative work that follows so the same class of failure does not recur.

-

Partner directly with Product and the Research team to shape the crew's technical and feature roadmap, including the SuDeP pipeline that Research consumes.

-

Mentor mid-level (P3) engineers toward senior scope, and act as a cross-crew technical consultant within the Commodities Tribe and the wider Engineering chapter.

Experience & Background

Essential

• 5+ years of experience as a software engineer, with experience delivering production systems.

• -
• Experience delivering technically ambiguous, business-critical projects end to end, owning the design, the trade-offs and the production outcome, not just the implementation.
• -
• Deep experience building and running data-intensive backends in Python (ETL/orchestration, relational data modelling, SQL/Postgres).
• -
• Owning systems in production: on-call, observability, incident response and the prevention work afterwards ("you build it, you run it").
• -
• Experience setting technical direction for a team and being the person other engineers consult on hard design decisions.

Desirable

• -
• Worked with Airflow (or comparable orchestration) and TypeScript/NestJS APIs, or can credibly ramp into a polyglot Python + TS estate.
• -
• Exposure to a real, evolving domain data model: commodities, energy, finance, logistics or another domain where correctness of the model is the product.
• -
• Familiarity with data-quality / anomaly-detection approaches, or the discipline of gating publication on quality.
• -
• Experience with IaC and GitOps delivery (Terraform, ArgoCD, k8s) and with serving versioned external client APIs.

Behavioural Competencies

• -
• You take ownership of problems and outcomes, not just individual tasks.
• -
• You think beyond the code and understand how engineering decisions impact the product and customers.
• -
• You are comfortable making technical decisions, challenging ideas, and helping shape the direction of the team.
• -
• You enjoy working on complex problems, learning new things, and adapting in a fast-moving environment.
• -
• You collaborate openly with engineers, Product, and Research teams to find the best solutions.
• -
• You share knowledge and help the people around you grow.