Skip to content
Code Colonies

Talent · AI and Data

Prompt and Evaluation Engineer

A specialist who writes prompts, test sets and quality checks so the AI answers the same way each time and stays within limits.

Indian businesswoman in office attire talking on the desk phone at her workstation

What they do

  • Builds test sets from real cases
  • Writes and versions prompts
  • Measures accuracy, tone and safety
  • Tries to make the system misbehave
  • Reports quality over time

When to bring one in

  • AI answers vary too much
  • A client wants proof the AI is accurate
  • Before switching to a new model

Specification

Core skills
Prompt design, Test design, Domain understanding, Red teaming, Analysis
Tools
Claude, OpenAI, Gemini, Langfuse, Promptfoo, Python

Seniority

  • Mid level3 to 5 years

    Builds test sets and prompts

  • Senior5 to 8 years

    Owns quality for one AI product

  • Lead8+ years

    Sets how AI is tested across teams

Request

Request a Prompt and Evaluation Engineer

Tell us about the project, stack and domain. We will share matched profiles, usually within one to two weeks.

Roles you need *
Team size
Seniority
Start
Duration

Start a conversation

Tell us what you are trying to build.

Share the problem in a short call. You leave with a clear view of the approach, the team and the cost.

Or get a ballpark proposal in two minutes

A specialist replies within one working day. The first conversation is free.

Chat with the Code Colonies team on WhatsApp