Senior AI Engineer

Mission Overview

Keystone Solutions is seeking a Senior AI Engineer to join a consultancy mission at a client site, focusing on the development of innovative AI services. This role involves working closely with internal teams to transform complex AI projects into operational services.

Role Responsibilities

As a Senior AI Engineer, you will be responsible for delivering various components of AI services under Keystone Solutions' consultancy model. Your key responsibilities will include:

• Delivering the RAG pipeline end-to-end, from retrieval strategy to answer generation.
• Creating the ingestion pipeline: connectors to source platforms, chunking, embedding, incremental refresh.
• Implementing security trimming and ACL propagation.
• Managing agent orchestration, prompt templates, and guardrails.
• Setting up evaluation and tracing: offline evaluation sets, retrieval and answer-quality metrics, end-to-end tracing of requests and agent steps.
• Producing Terraform, Helm, and Azure DevOps artifacts needed for service deployment and operation.
• Ensuring observability and cost control: instrumentation for latency, token consumption, and run cost, plus quality regression detection after model or prompt changes.
• Providing hypercare and early production support: incident analysis, tuning, runbooks, documentation, and handover of the service to the engineer responsible for the Run phase.

Why Join Keystone Solutions?

By joining Keystone Solutions, you will experience:

• Consultancy Nature: Engage in on-site work, embodying the consultant identity.
• Dynamic Projects: Tackle a variety of challenges across different client environments.
• Turbo-Charged Learning: Benefit from professional development and broad learning experiences.
• Skyrocketing Ambition: Enjoy a commitment to career growth within our framework.
• Values: As a
  

  Duration: As soon as possible - 02/11/2026 4 weeks • (full time)

  
  

  Skills required

  • Azure DevOpsAdvanced · used this year
  • Azure Kubernetes Service - AKSAdvanced · used this year
  • Azure OpenAI ServiceAdvanced · used this year
  • LangChainIntermediate
  • LLM / Large Language ModelsAdvanced · used this year
  • PythonAdvanced · used this year
  • RAG (Retrieval-Augmented Generation)Advanced · used this year
  • TerraformAdvanced · used this year
  • Vector databasesIntermediate · used this year
  
  

  Language requirements

  • Dutch / FrenchNative or bilingual proficiency
  • EnglishFull professional proficiency