Expert Python Engineer

Expert Python Engineer

Ciklum

Remote, Poland

About the role:

As an Expert Python Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. We are partnering with Client to significantly upgrade the Retrieval-Augmented Generation (RAG) architecture of their AS Copilot system. Our goal is to drastically reduce AI hallucinations in code generation and optimize retrieval latency without re-architecting their existing platform.

Responsibilities:

• Act as the primary architectural authority for the AS Copilot RAG pipeline upgrade
• Lead the overall strategy for tuning re-rankers, grounding, and citation efforts, while providing high-level supervision to the engineering team
• Design the overarching architecture for custom "Code-RAG" development, specifically focusing on AST-aware semantic chunking for industrial automation code
• Ensure all AI components are architected to be delivered securely as Python source code directly into the client’s Azure DevOps environment
• Pipeline Strategy & Evaluation: Oversee comprehensive RAG pipeline audits, establish critical baseline KPIs, and dictate robust evaluation frameworks using tools like RAGAS
• Advanced Retrieval Architecture: Define the approach to tune cross-encoder rerankers on Azure ML and design the architecture for multi-turn grounding and claim-level citation frameworks
• Code-RAG Leadership: Architect custom tokenization and semantic chunking strategies for IEC 61131-3 structured text, avoiding generic tokenizers that destroy function block semantics
• Engineering Oversight: Ensure the delivery of clean, production-grade Python code, oversee architectural code reviews, and provide high-level technical direction to senior and mid-level implementation engineers
• Client Collaboration: Work directly within the client's SAFe cadence, driving joint architectural decisions and ensuring continuous knowledge transfer

Requirements:

• Background: Strong background in Computer Science, Machine Learning, Data Science, or a related technical field at an architectural level
• AI/NLP Expertise: Deep, practical experience and architectural mastery over Large Language Models (LLMs) and advanced Retrieval-Augmented Generation (RAG) architectures
• Technical Stack: Highly proficient in Python. Expert-level experience designing systems with PostgreSQL, pgvector, and hybrid search strategies (BM25 + dense) is required
• Cloud & MLOps: Hands-on, architectural-level experience with the Azure ecosystem, specifically Azure OpenAI, Azure Machine Learning, and Azure DevOps
• Evaluation Frameworks: Deep familiarity with LLM evaluation methodologies and tools like RAGAS, DeepEval, or custom Python test harnesses
• Code Parsing: Extensive exposure to Abstract Syntax Trees (AST) or custom grammar parsing for code-generation use cases is highly desirable
• Soft Skills: Effective problem-solving mindset, capable of high-level client-facing technical leadership, and comfortable working in an embedded, co-delivery partnership