Skip to content
← Back to job listings

Senior Software Engineer (Infra Agent Systems)

Together AI · San Francisco, United States

RemoteImported listingfull-time28 days ago

About The Role

Join our team as a Senior Software Engineer (Infra Agent Systems) and work on two challenging problems: making AI agents trustworthy for production infrastructure and building the systems that make those agents effective. You'll have the opportunity to build foundational systems from the ground up, work on infrastructure at massive scale, and help define how self-improving AI agents operate real-world AI infrastructure.

  • Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
  • Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
  • Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
  • Depth in at least one of the following:
  • Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms
  • AI agent systems, orchestration, tool use, evaluation, or grounding
  • Search, retrieval, ranking, RAG, or semantic search systems
  • Knowledge graphs or graph data modeling
  • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
  • Comfortable working across languages such as Go, TypeScript, Python, or Rust
  • 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
  • Strong systems design skills and experience owning significant systems from design through production
  • Observability platforms such as Prometheus and Grafana
  • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
  • Event-driven systems and messaging platforms such as NATS or Kafka
  • Graph databases
  • GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers

This is an external listing. JobSpring does not represent or verify the employer. Report this listing