Principal AI Platform Engineer

Principal AI Platform Engineer

Arm

Cambridge, United Kingdom

Job Overview:

We are building a central AI control plane to support the safe, scalable, and efficient use of AI across Arm’s engineering teams.

This hands-on, technical leadership, platform engineering role will help direct and own delivery of the runtime platforms that make AI services reliable, secure, observable and supportable at Arm scale. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, incident management and automation to provide the production foundation for Arm’s AI platform.

Participate in production support and our paid on-call rota for high impact incident response.

Production AI runtime platforms:

• Build/deploy and operate the infrastructure for centrally hosted AI platform services, including MCP server infrastructure, model gateway services and supporting control-plane components.
• Design runtime patterns for isolation, scalability, secure execution, capacity management and cost-aware operation.
• Automate provisioning, configuration, upgrades and lifecycle management using infrastructure-as-code and GitOps patterns.

Reliability, observability and support:

• Define and implement service-level indicators, service-level objectives, alerting, dashboards, runbooks and support workflows.
• Incident response, post-incident review and vendor outage handling for AI services embedded in engineering workflows.
• Build telemetry that helps Arm understand AI platform health, usage, performance, cost and operational risk.

Secure operations by default:

• Ensure platform components meet production readiness, security and compliance expectations.
• Help make secure AI usage the default by providing reliable paved paths rather than manual or fragmented infrastructure.

Responsibilities:

• Technical leadership - this role will become a recognised expert and lead engineer on our AI platform's technology stack.
• Build, operate and continuously improve the production infrastructure for Arm’s AI platform services, using both custom and third party solutions.
• Own reliability, scalability, monitoring, alerting, incident response, runbooks and operational readiness for AI platform components.
• Develop automation for provisioning, deployment, configuration, backup, recovery, patching, upgrades and lifecycle management.
• Implement secure runtime patterns, including workload isolation, secrets management, identity integration, network controls and auditability.
• Contribute towards platform roadmap planning and prioritisation.

Required Skills and Experience:

• Expert level experience deploying and operating production infrastructure or platform services in a Linux-based environment using Kubernetes, containers, cloud or private-cloud platforms, infrastructure-as-code and CI/CD/GitOps tooling.
• Very strong understanding of security fundamentals for production platforms, including identity, secrets, access control, network segmentation, vulnerability management and audit logging.
• Familiarity with AI platform concepts such as model routing, MCP servers, agentic workflows, RAG systems or LLM observability.
• Very strong automation and scripting skills, for example Terraform, Go, Python or similar.
• Experience with incident management, problem management, demand forecasting, and production readiness practices.

“Nice To Have” Skills and Experience:

• Experience operating internal developer platforms, AI platforms, model gateways, MCP infrastructure or other shared engineering platforms.
• Experience with service mesh, policy-as-code, workload identity, sandboxing, secure runtime environments or multi-tenant platform designs.
• Experience with regulated or security-sensitive engineering environments.
• Working knowledge of Open AI tools, products and APIs!