Senior Product Engineer (Agent Training and Evals)

<h2 style="text-align: center;"><span style="color: rgb(126, 140, 141);">Se</span><span style="color: rgb(0, 0, 0);"><span style="color: rgb(126, 140, 141);">nior Product Engineer (Agent Training and Evals)</span></span></h2> <p style="text-align: center;"><span style="color: rgb(126, 140, 141);">Engineering</span></p> <p style="text-align: center;"><em> </em></p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141);"><em>Prolific</em></span></p> <p style="text-align: left;">Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models.</p> <p style="text-align: center;"> </p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141);"><em>The role</em></span></p> <p style="text-align: left;">As a Senior Product Engineer, you'll be one of the early engineers in our Agentic Training & Evals team.</p> <p style="text-align: left;">You'll build the infrastructure that lets us evaluate AI agents, alongside real human expert work in safe and secure environments.</p> <p style="text-align: left;">This is a genuine 0→1 role. There isn't a well-established playbook or existing architecture for you to simply maintain. You'll have significant influence and ownership over the technical direction of the team and the products we build.</p> <p style="text-align: left;">You'll work closely with engineering, product and AI research to turn ambiguous problems into scalable systems, and you'll see the impact of what you build directly.</p> <p style="text-align: center;"> </p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141);"><em>What you’ll bring to the role</em></span></p> <ul style="text-align: center;"> <li style="text-align: left;">Strong experience building scalable infrastructure or distributed systems in the cloud</li> <li style="text-align: left;">Solid understanding of how systems are deployed, scaled and secured</li> <li style="text-align: left;">Hands-on experience with evaluating AI models or agents</li> <li style="text-align: left;">Interest in how AI agents are trained, evaluated and improved</li> <li style="text-align: left;">Bonus: experience with image, video, or audio processing</li> <li style="text-align: left;">Strong product mindset with a focus on delivering business and customer value</li> <li style="text-align: left;">Comfort with ambiguity, and the ability to move quickly from idea to working system</li> <li style="text-align: left;">Strong communication and collaboration skills</li> <li style="text-align: left;">Python experience is useful, but not essential</li> </ul> <p style="text-align: center;"> </p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141);"><em>What you’ll be doing in the role </em></span></p> <ul style="text-align: center;"> <li style="text-align: left;">Solve hard problems aroun…