Platform Engineer — Core Infrastructure

About Us

100ms operates two product lines at scale: a real-time Live Video platform powering latency-sensitive, high-concurrency video experiences, and an AI Agents platform that automates complex patient access workflows in U.S. healthcare.

Both products run on a shared, robust infrastructure foundation. You'll be joining the central platform team responsible for keeping both running reliably, securely, and at scale — serving developers and healthcare operators who depend on us around the clock.

What Will You Do

• Own and operate production infrastructure across multiple GKE clusters supporting both real-time video workloads and AI agent pipelines — with HA, autoscaling, and full observability tuned to the demands of each.

-

Manage GitOps workflows using Argo CD for automated, version-controlled, and auditable deployments across both product lines.

-

Maintain and optimize monitoring & alerting stacks using Open Source Monitoring Tools — with product-specific SLOs for low-latency video (jitter, packet loss, stream health) and AI workflow reliability (task throughput, failure rates, retry queues).

-

Implement infrastructure as code using Terraform for GCP resources and helm chart for Kubernetes manifests, with a strong bias toward repeatability and auditability.

-

Support the unique infrastructure demands of real-time video — including media server scaling, WebRTC infrastructure, low-latency networking, and high-throughput data paths.

-

Support AI agent workloads — including LLM inference infrastructure, async task queues, and integration pipelines with external healthcare systems.

-

Lead or support incident response, cluster upgrades, and disaster recovery procedures across both platforms.

-

Own the security posture of our infrastructure — enforce least-privilege access controls, manage secrets hygiene, and drive security hardening across clusters and services.

-

Implement and maintain compliance-aligned controls relevant to healthcare data environments (e.g., encryption at rest/in transit, audit logging, network segmentation).

-

Collaborate with product and engineering teams to embed security early in the development lifecycle — shift-left on vulnerability scanning, dependency audits, and policy enforcement.

Who Can Apply

• -
• Computer Science / Engineering degree or equivalent practical experience.
• -
• Minimum 3 years of hands-on experience with Kubernetes in a production environment.
• -
• Strong knowledge of CI/CD pipelines and GitOps workflows using Argo CD or similar tools.
• -
• Proficient in infrastructure automation using Terraform and Helm.
• -
• Experience in managing open source monitoring and logging stacks (Prometheus, Loki, Grafana, Alertmanager etc).
• -
• Working knowledge of cloud security principles — IAM, network policies, pod security, RBAC, and secrets management.
• -
• Comfortable with Linux systems, shell scripting, and basic networking — including an understanding of UDP/TCP behaviour relevant to real-time media or distributed systems.

Good to Have

• -
• Prior experience managing large-scale, multi-tenant or mixed-workload infrastructure.
• -
• Exposure to real-time media infrastructure — WebRTC, SFUs, TURN/STUN servers, or media server orchestration.
• -
• Hands-on experience with secrets management tools such as HashiCorp Vault or Sealed Secrets.
• -
• Familiarity with security scanning and policy tools (e.g., Trivy, OPA/Gatekeeper, Falco).
• -
• Experience with GCP and GKE specifically.
• -
• Exposure to compliance frameworks relevant to healthcare or regulated industries (HIPAA awareness is a plus).
• -
• Experience with AI/ML inference workloads or async pipeline infrastructure (queues, workers, orchestrators).
• -
• Experience with open source contributions.
• -
• Strong inclination to stay current with evolving infrastructure, security, and platform engineering practices — and a willingness to share ideas internally or externally.
• -
• Ability to communicate fluently and clearly in English, written and spoken.

Why 100ms

-

You'll work on genuinely varied infrastructure — real-time video at scale and AI-driven healthcare automation are both hard problems with different constraints, and you'll own both.

-

You'll be part of a small, high-ownership team at a fast-growing, engineering-first startup with a meaningful mission — powering real-time experiences and helping patients access treatment faster.

-

You'll work alongside engineers with deep experience in distributed systems, real-time media, AI infrastructure, and platform engineering at scale.

-

You'll have the freedom to grow as an individual contributor or step into a team leadership role — with room to define your own goals and impact.

-

Security and infrastructure are first-class concerns here, not support functions — your work directly shapes the trust and reliability our customers depend on.

Additional Information

• -
• We place a strong emphasis on in-office collaboration to maintain a tight feedback loop and a strong engineering culture.
• -
• Employees are expected to work from the office at least three days a week.

Website

• https://www.100ms.ai/
• https://www.100ms.live