Senior Software Engineer (AI Engineering)

Join Smartsheet, a leading platform for work management and automation. As a Senior Software Engineer (AI Engineering), you will play a critical role in building AI-powered strategic planning and work execution agents. You will work closely with engineering and AI platform teams, design and build production-grade LLM-powered agents, and implement end-to-end AI systems on cloud infrastructure. You will also mentor and guide other engineers, establish best practices for AI development, and stay current with the rapidly evolving AI/LLM landscape.

• Architect and design production-grade LLM-powered agents and workflows within Smartsheet, including system design, data pipelines, and deployment strategies.
• Develop and optimize prompts, RAG pipelines, and agent reasoning patterns; build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
• Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, or Azure), including monitoring, optimization, and incident response.

• Fluency in agent system design, you don't need to own the architecture, but you can engage as a peer on architectural tradeoffs that affect quality
• Ability to communicate complex quality findings (written and verbal) to both technical and non-technical stakeholders, you can explain what’s broke, why it matters, and what needs to happen next without losing the room
• Strong cross-functional judgment, you know when to escalate, when to resolve independently, and how to build credibility across engineering, product, and AI platform teams
• Deep, hands-on experience with prompt engineering and context engineering, you understand how model behavior changes with framing, structure, and input design
• BS or MS in Computer Science, a related field, or equivalent industry experience
• A bias for clarity in ambiguous situations, when failure modes are murky and trade-offs are real, you bring structure and a clear point of view rather than waiting for consensus
• Legally eligible to work in the U.S. on an ongoing basis
• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
• Strong Python skills; comfortable working in data-heavy environments (Databricks, Delta tables, or equivalent)
• Experience building or extending LLM evaluation frameworks, you have designed scorers, worked with golden datasets, and thought carefully about what good looks like
• Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis
• Experience with MLflow or similar experiment tracking platforms
• Familiarity with CI-integrated evaluation pipelines
• Experience with multi-agent orchestration frameworks
• Prior work in an Applied AI or LLMOps function within a product company