AI Research Engineer

<h1 style="text-align: center;"><span style="color: rgb(126, 140, 141);">      <span style="font-family: tahoma, arial, helvetica, sans-serif;">AI Research Engineer</span></span></h1> <p style="text-align: center;"><span style="color: rgb(126, 140, 141); font-family: tahoma, arial, helvetica, sans-serif;">  </span><span style="font-family: tahoma, arial, helvetica, sans-serif;">             </span></p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141); font-family: tahoma, arial, helvetica, sans-serif;"><em>  Prolific</em></span></p> <p style="text-align: left;"><span style="font-family: tahoma, arial, helvetica, sans-serif;">Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models.</span></p> <p style="text-align: center;"><span style="color: rgb(126, 140, 141); font-family: tahoma, arial, helvetica, sans-serif;"><em>  </em></span></p> <p style="text-align: center;"><em>The Role</em></p> <p><br>Prolific AI Research (PAIR) is the AI research group at Prolific (<a href="https://labs.prolific.com/">https://labs.prolific.com/</a>). We work on the science of evaluation: how to measure AI systems well, grounded in real human judgement at population scale. We are seeking a Research Engineer to conduct innovative research in key AI areas including evaluation methodologies (particularly those grounded in human data), alignment techniques, and synthetic data generation. You'll bridge the gap between cutting-edge AI research and practical applications, helping to translate research insights into valuable products and services. As part of our commitment to contribute to the wider AI community, you'll be involved in writing papers that advance the field. Your work will directly impact how we understand, evaluate, and improve AI systems through high-quality human data.</p> <p> </p> <p style="text-align: center;">What You’ll Be Doing</p> <p><br><strong>Research & Innovation</strong></p> <ul> <li>Lead independent research projects in AI evaluation methodologies, alignment techniques, and synthetic data generation</li> <li>Design and implement novel evaluation frameworks for LLMs and agent systems that are grounded in human data</li> <li>Contribute to the academic AI community through publications and open-source contributions</li> <li>Stay at the forefront of AI research and pioneer innovative approaches to tackle pressing open challenges in the field</li> </ul> <p><br><strong>Technical Implementation</strong></p> <ul> <li>Design and conduct rigorous experiments to study AI models and systems with sound methodological approaches</li> <li>Develop scalable frameworks for systematic evaluation of model behaviours and capabilities</li> <li>Create tools and frameworks that transform research insights into practical applications</li> <li>Build infrastructure to support large-scale research experiments when needed</li> <li>Apply knowledge of model fine-tuning, optimization techniques, distillation,…