Indeed Contextual Job Matching with OpenAI

Indeed has integrated OpenAI's GPT models to enhance its "Invite to Apply" feature, providing job seekers with personalized, contextual explanations of why a specific job is a good fit for their background. This implementation has led to a 20% increase in started job applications and a 13% uplift in downstream success, indicating a higher rate of qualified candidates being hired.

Optimizing Job Recommendations with Generative AI

Indeed's existing AI matching technology identifies connections between job seekers and employers, but the company sought to improve the "explainability" of these recommendations. By utilizing OpenAI's GPT models, Indeed transitioned from providing brief explanations to offering insightful, natural language context that details why a candidate's previous work experience makes them a suitable match for a specific role.

Technical Implementation and Efficiency Gains

Indeed's engineering team began implementing the solution in 2023 using the Chat Completions API and few-shot prompting. To scale the system to millions of users while managing costs and latency, Indeed and OpenAI collaborated on the following technical optimizations:

  • Model Fine-Tuning: Indeed fine-tuned a smaller GPT model to achieve performance parity with larger models while reducing token consumption by 60%.
  • Data Augmentation: The team used GPT-4 for data augmentation to create high-quality training sets.
  • Annotation and Evaluation: An annotation operation was established to label LLM-generated outputs and create ground truths for automated evaluation.
  • Infrastructure Scaling: In January 2024, Indeed adopted dedicated instances to support the deployment of the fine-tuned model to millions of job seekers.

Measurable Impact on Recruitment Metrics

Through a multi-stage experiment that scaled from 1 million to nearly 20 million messages per day, Indeed compared the GPT-powered personalized messaging against traditional job matching versions. The results demonstrated significant growth in engagement and hiring efficiency:

  • Application Volume: There was a 20% increase in the number of job applications started.
  • Hiring Success: There was a 13% uplift in downstream success, meaning employers found the applicants to be a better fit, leading to more hires.
  • Business ROI: CEO Chris Hyams noted that the implementation was "ROI-positive," contributing to revenue growth.

Broader Integration Across Indeed

Beyond the "Invite to Apply" feature, Indeed is utilizing OpenAI technology in nearly a dozen other products to personalize the experience for job seekers and accelerate the hiring process for employers. As Chris Hyams stated:

"Combining OpenAI's GPT explanations with Indeed's own proprietary AI and vast marketplace data allows us to connect more people to jobs, faster—a win for job seekers, employers, and society."

Sources