← Back to job listings

Senior Software Engineer (Infra Agent Systems)
Together AI · San Francisco, United States
About The Role
Join our team as a Senior Software Engineer (Infra Agent Systems) and work on two challenging problems: making AI agents trustworthy for production infrastructure and building the systems that make those agents effective. You'll have the opportunity to build foundational systems from the ground up, work on infrastructure at massive scale, and help define how self-improving AI agents operate real-world AI infrastructure.
- Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
- Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
- Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
- Depth in at least one of the following:
- Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms
- AI agent systems, orchestration, tool use, evaluation, or grounding
- Search, retrieval, ranking, RAG, or semantic search systems
- Knowledge graphs or graph data modeling
- Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
- Comfortable working across languages such as Go, TypeScript, Python, or Rust
- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
- Strong systems design skills and experience owning significant systems from design through production
- Observability platforms such as Prometheus and Grafana
- Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
- Event-driven systems and messaging platforms such as NATS or Kafka
- Graph databases
- GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers
Similar roles you might like
See all →1B
Medical Assistant - Cardiology
1400 Baystate Medical Practices, Inc
$21 – 26/hrPosted today
1B
Clinical Psychologist
1400 Baystate Medical Practices, Inc
$89,606 – 103,001/hrPosted today
1B
Medical Assistant - Pre Op Clinic
1400 Baystate Medical Practices, Inc
$21 – 26/hrPosted today
1B
Surgical Technologist
100 Baystate Medical Center
$32 – 39/hrPosted today
1B
Registered Nurse Observation Unit
100 Baystate Medical Center
$42 – 54/hrPosted today
1B
Patient Care Technician Full Time Days
100 Baystate Medical Center
$17 – 21/hrPosted today
1B
Admin Coordinator - Behavioral Health
100 Baystate Medical Center
$22 – 25/hrPosted today
1B
Nurse Clinician, Cardiac Rehabilitation
100 Baystate Medical Center
$72,800 – 101,774/hrPosted today
This is an external listing. JobSpring does not represent or verify the employer. Report this listing