AI Evaluation Engineer

SBA are currently supporting our Central Government client who are seeking an AI Evaluation Engineer on an initial 4 month contract.

Location: London, Bristol OR Manchester (hybrid office attendance)

Overview:

The team is looking for an experienced, hands-on developer who can create their own base code, set it up and work it out. Experience applying and working with AI model layer & agentic layer

The ideal candidate:

• proven experience in quality engineering, testing or evaluation of data-driven and AI-powered products.
• strong understanding of machine learning systems, large language models (LLMs) and AI evaluation methodologies for production.
• experience defining performance metrics, KPIs, benchmarks and acceptance criteria for AI products.
• ability to translate business risks and policy requirements into measurable technical evaluation frameworks.
• experience developing automated testing and evaluation pipelines using Python or similar technologies.
• knowledge of AI safety, model robustness, bias, fairness and responsible AI principles.
• strong analytical and problem-solving skills with the ability to identify trends, risks and performance issues.
• experience working with cross-functional teams in agile product delivery environments.
• ability to communicate complex technical findings clearly to bot...