research
Posted 2 hours agoAI Research Engineer
at Prolific
United KingdomRemote
Responsibilities
- Lead independent research projects in AI evaluation methodologies, alignment techniques, and synthetic data generation
- Design and implement novel evaluation frameworks for LLMs and agent systems that are grounded in human data
- Design and conduct rigorous experiments to study AI models and systems with sound methodological approaches
- Develop scalable frameworks for systematic evaluation of model behaviours and capabilities
- Create tools and frameworks that transform research insights into practical applications
- Build infrastructure to support large-scale research experiments when needed
- Mentor team members on advanced AI concepts and emerging research directions
Requirements
- AI Research Engineer
- Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development.
- In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models. The Role
- We're seeking a Research Engineer to conduct innovative research in key AI areas including evaluation methodologies (particularly those grounded in human data), alignment techniques, and synthetic data generation.
- You'll bridge the gap between cutting-edge AI research and practical applications, helping to translate research insights into valuable products and services.
- As part of our commitment to contribute to the wider AI community, you'll be involved in writing papers that advance the field.
- Your work will directly impact how we understand, evaluate, and improve AI systems through high-quality human data.
- Contribute to the academic AI community through publications and open-source contributions
- Stay at the forefront of AI research and pioneer innovative approaches to tackle pressing open challenges in the field
- Apply knowledge of model fine-tuning, optimization techniques, distillation, and other ML engineering practices to support research goals
- Work closely with ML engineers, data scientists, and product teams to translate research insights into practical applications
- experience with significant AI/ML focus
- experience through publications, open-source contributions, or impactful projects
- Strong engineering fundamentals and
- experience implementing AI systems in production environments
- Deep knowledge of LLM evaluation methodologies, alignment techniques, and model optimization approaches •
- Experience with model fine-tuning, adapters, quantization, and distillation frameworks
- Excellent understanding of current challenges in AI safety, reliability, and alignment
- Passion for staying current with the rapidly evolving AI research landscape
- This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
- We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviors into AI development.
- By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation – one that reflects the breadth and the best of humanity.
- Working for us will place you at the forefront of AI innovation, providing access to our unique human data platform and opportunities for groundbreaking research.
Experience
- 5+ years of engineering
Benefits
- Join us to enjoy a competitive salary, benefits, and remote working within our impactful, mission-driven culture.
Additional details
- Communicate complex technical concepts to diverse stakeholders
- Strong communication skills and ability to explain complex research concepts clearly
- We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback.
- Links to more information on Prolific Benefits
- External Handbook Website Youtube