research
Posted YesterdayAI Researcher
at HackerRank
IndiaHybrid
Responsibilities
- Design and execute research studies to define what "good performance" means across different job contexts, industries, and candidate types.
- Build the datasets, annotation frameworks, and ground truth labels that ML models on the Evaluation team learn from.
- Own the bias audit process: identify where our evaluation systems treat groups differently, understand why, and recommend what to change.
- Conduct customer and industry interviews to understand how enterprise clients define skilled performance, then translate those signals into measurable constructs.
- Write and maintain documentation on research methodology that product, ML, and commercial teams can reference and trust.
Requirements
- Software has entered an era where humans and AI build side by side.
- Candidates today work alongside AI assistants, engage in multi-turn conversations, and produce outputs that blend human and machine reasoning.
- What looks like a correct answer in a Python interview looks different when a transcript is in the mix.
- Stay current on relevant literature in educational measurement, psychometrics, algorithmic fairness, and LLM evaluation, and bring applicable ideas into the work. Who you are
- You have a Master's or PhD in a research-intensive discipline: cognitive science, computational social science, NLP, educational measurement, human-computer interaction, or a closely adjacent field.
- You know how to design a methodology from scratch.
- You communicate findings to non-researchers without oversimplifying. You know how to make a methodology legible to a PM, a customer, and an engineer. Even better if you have
- Familiarity with psychometric frameworks, IRT, or educational assessment standards.
- Published work or thesis research touching on algorithmic fairness, evaluation design, or human judgment in AI systems. •
- Experience running user research or qualitative studies alongside quantitative modeling.
Contact
- Want to learn more about HackerRank? Check out HackerRank.com to explore our products, solutions and resources, and dive into our story and mission here .