Built on How Hiring Research Actually Works

Most agency owners hire the way they were hired: a conversation, a gut read, and a hope that the person who interviewed well will sell well. The research says that habit leaves a lot on the table.

The largest recent review of hiring methods found that the tools most agencies lean on, an informal interview and a general personality read, are among the weakest predictors of job performance. The strongest ones have something in common: they are built around the actual job.

What the research found

In 2022, Paul Sackett and colleagues re-examined decades of hiring studies and corrected a statistical over-adjustment that had inflated older estimates. Their updated rankings, published in the Journal of Applied Psychology, reshuffled the list.

The top four are all job-specific: they look at what the role demands and measure that directly. The bottom of the list is where most informal hiring lives.

Why job-specific methods win

General measures ask a broad question: is this person smart, organized, likable? Job-specific methods ask a narrower one: how does this person behave in the situations this seat actually puts them in? The narrower question turns out to be the better predictor.

Three patterns stand out in the findings:

• Structure beats conversation. The same interview, asked the same way with the same scoring guide for every candidate, roughly doubles the predictive value of a free-form chat (.42 vs .19).
• Context beats generality. Personality measured in general terms predicts weakly. The researchers found that tying personality items to the job context makes them more predictive.
• Cognitive ability isn’t king. For decades it was treated as the single best predictor. After correcting a statistical over-adjustment in older studies, it lands mid-table at .31.

No method is perfect. Even structured interviews vary a lot depending on how well they are designed and run. That is the case for combining methods rather than betting on any one.

What this means for hiring in your agency

A producer, a customer service rep and an office administrator succeed for different reasons. A producer needs to bounce back from the tenth “no” of the day. A service rep needs to hold a frustrated client’s trust while staying inside process. Measuring all three against the same generic yardstick blurs exactly the differences that matter.

In practice, that points to three habits any agency can adopt:

1. Define the seat before you meet the candidate. Write down the four or five behaviors that separate a strong hire from a weak one in that specific role.
2. Ask every candidate the same questions. Use one question set per role and score answers against the same guide.
3. Add a job-related signal before the interview. Something that measures behavior in the context of the role, so the interview confirms or challenges evidence instead of starting from scratch.

An interview on its own is a coin flip with good manners. Structure and context are what move the odds.

How Predictive Hiring Intelligence puts it to work

Predictive Hiring Intelligence is built on this research. Instead of a generic personality test, candidates complete an assessment designed around the role they are applying for: producer, service and sales, financial advisor or administrative. Each model is scored against what that seat actually requires.

The result is a role-fit score and a behavioral profile you bring into a structured interview. The score is evidence, not a verdict. It is an input to your decision, never the thing that decides.

That pairing, job-context behavior plus a structured conversation, is the approach the research keeps pointing back to.

The bottom line

Hiring well isn’t about finding a magic test. It is about measuring the right things, in the context of the job, the same way every time. See how it works in a live demo.