AI DevOps Engineer

AI DevOps Engineer

osapiens

Mannheim, Germany

We’re looking for an AI Development Operations Engineer to build and operate the internal AI infrastructure that empowers our developers to work smarter and ship faster. You will integrate cutting-edge AI systems like Claude, Codex and next-generation agentic frameworks directly into engineering workflows, making AI a natural part of how we design, build and maintain software.

Your Responsibilities

Platform Engineering

• Design and operate our end-to-end AI platform (RAG pipelines, retrieval, indexing, embeddings, vector DBs).
• Build MCP Servers, extensions and integrations for IDEs, CI/CD systems and internal tooling.
• Create orchestration interfaces that allow AI agents to interact safely with internal systems.

Agent Skills & Automation

• Develop reusable agent skills for architecture reasoning, secure coding, test generation, debugging and more.
• Maintain and evolve a skill library aligned with engineering needs and platform adoption.

AI Powered Developer Experience

• Automate code review, CI checks and troubleshooting with LLM-based workflows.
• Provide context aware knowledge retrieval across codebases, logs, docs, incidents and design artifacts.

Governance & Reliability

• Define guidelines for prompt engineering, model evaluation and cost optimization.
• Implement monitoring, audit logging, performance tracking and access controls.

Collaboration

• Partner closely with engineering, product and qa-teams.
• Communicate platform strategy and progress to leadership.
• Support developers in adopting and maximizing AI based workflows.

Your Experience

Technical Skills

• Strong software engineering background (Python + one systems language like Typescript/Java).
• Experience with LLM APIs (OpenAI, Claude, Gemini) and agent frameworks (LangChain, LlamaIndex).
• DevOps/MLOps expertise: Kubernetes, Docker, CI/CD, observability.
• Cloud architecture experience (AWS/GCP/Azure) optimized for AI workloads.
• Hands-on knowledge of retrieval systems and vector databases (Pinecone, Weaviate, etc.).
• Solid understanding of security, compliance and safe AI usage.

Additional Strengths

• Experience with knowledge graphs, largescale ingestion pipelines, finetuning or advanced prompting.
• Background in developer experience, internal platforms or productivity engineering.
• Proven technical leadership and strong cross functional collaboration skills.

Your Mindset

You thrive as a cross functional partner who aligns naturally with engineering, product, design, security and leadership. You communicate technical strategies clearly, shape actionable roadmaps and enable developers through practical guidance, training and strong documentation. Rapid prototyping, fast iteration and evaluating new models for real impact are core elements of how you work.