A client in Conyers called us in October with a staffing problem that was two quarters in the making. Three departments running at 60% headcount. Peak season six weeks out. When we asked how their current agency was performing, they said the numbers looked fine. Fill rate above 80%, they thought. No major complaints. What they hadn't tracked: the NCNS rate on first shifts, which had been drifting past 20% for four months. Or the 90-day turnover, which ran nearly 55%. They'd been measuring the wrong things, and the agency had no reason to surface it. We took the account in November and spent the first two weeks just establishing the real baseline.
A staffing vendor scorecard measures your agency's performance across five categories (fill rate, time-to-fill, NCNS rate, 90-day retention, and compliance) on a quarterly cycle. The goal is to catch performance problems before they become headcount crises, and to give your agency a clear standard to hit rather than a vague "do better" conversation after something goes wrong.
Why Most Vendor Reviews Come Too Late
Annual reviews don't catch drift. The pattern we see with clients who've had a single staffing vendor for 18 months or more: performance slips a few points per quarter, nobody formally documents it, and then something breaks (a missed Q4 ramp, a compliance gap, three weeks of first-day no-shows) and the review happens reactively. You've already absorbed the damage before you've even opened the conversation.
Quarterly cadence gives you three inflection points before year-end. If fill rate drops from 88% to 79% between Q1 and Q2, a quarterly scorecard shows it while you still have time to put the agency on a performance plan, bring in a backup vendor, or adjust your hiring timeline. Annual reviews catch that same number in December.
The other thing quarterly review does is give your agency something to aim for. We run scorecard reviews with clients who share results back with us, and the honest truth is that we perform better on those accounts. Not because we're gaming the number. Having a defined metric forces us to track the same things internally, and that alignment shows up in placements.
Companies with formal vendor evaluation programs report saving 12-18% on procurement costs, according to Spendflo's 2026 vendor scorecard analysis. The staffing equivalent isn't cost savings on the bill rate; it's avoiding the much larger cost of rebuilding a production line that ran thin for two quarters while the account drifted.
The Five Metrics Every Scorecard Needs
A scorecard with 12 columns is a scorecard nobody updates. Here are the five that actually separate good from mediocre in light industrial and warehouse staffing. Track these every quarter, defined consistently, and you'll have what you need.
Fill rate is the baseline: the percentage of your open requisitions the agency filled within the agreed timeline. In Georgia light industrial, an agency with real local depth should hit 85% or better on standard roles. We target 90% across our 27 accounts. Below 75% for two consecutive quarters is structural; it usually means the agency is working from a thin bench or overcommitting to more clients than their recruiting capacity supports.
Time-to-fill matters separately because an agency can hit 90% fill by taking 10 days on every role while padding the SLA. For ongoing production and warehouse accounts, standard fills should close in 48 to 72 hours. First-time fills for specialized roles (forklift-certified, bilingual supervisor) take longer; three to five days is reasonable. If standard roles are running five-plus business days, the local candidate pool isn't what the agency told you it was.
NCNS rate is what most clients undertrack. This is the percentage of placed workers who don't show up on day one or a scheduled shift without advance notice. It sounds like a workforce problem. It's mostly a screening problem. Workers who've been prepped, placed in appropriate roles, and actually spoke with a recruiter who answered their questions show up at materially higher rates than workers who received a text with a start time. NCNS above 10% on a first-shift basis is worth a direct conversation.
90-day retention measures whether placed workers are still on assignment at the 90-day mark. More than 40% of new hires in light industrial leave within the first 90 days, based on retention data across Georgia light industrial accounts. An agency contributing to that churn through poor candidate fit or weak early-assignment support is adding hiring cost you're paying for. A reasonable target: 90-day retention above 65% for standard production roles.
Compliance completion rate covers I-9/E-Verify accuracy, background check completion, drug screen documentation, and any safety certifications your facility requires. The floor is 100% documentation completion before a worker's first shift, every time. A single I-9 error surfaced in an ICE audit is more costly than six months of tracking this metric. If your agency can't consistently hit 100%, that's not a documentation problem. It's a process problem that affects your legal exposure directly.
How to Weight and Score Your Agency
Weighting acknowledges that not every metric hits your operation the same way. A facility with compliance risk from prior audit findings weights that metric higher. A distribution center running at peak demand all quarter weights time-to-fill higher. The framework below is a starting point; adjust the weights to match your priorities, but keep them consistent quarter over quarter so you can compare.
| Metric | Weight | 4 pts | 3 pts | 2 pts | 0 pts | |---|---|---|---|---|---| | Fill rate | 30% | ≥90% | 85–89% | 75–84% | <75% | | 90-day retention | 25% | ≥70% | 60–69% | 50–59% | <50% | | NCNS rate | 20% | ≤5% | 6–10% | 11–15% | >15% | | Time-to-fill (std. roles, days) | 15% | ≤2 | 3–4 | 5–6 | >6 | | Compliance completion | 10% | 100% | 99–99.9% | 98–98.9% | <98% |
Multiply each score by its weight and sum to a composite out of 4.0. A score of 3.2 or above is strong. 2.8 to 3.2 is a performance conversation. Below 2.8 for two consecutive quarters means the agency is creating more operational drag than value.
One honest note about how we arrived at this: we initially weighted compliance at 20% in our recommended framework. After running a few quarterly reviews, it penalized agencies for documentation delays that turned out to be the client's own onboarding system routing I-9s through a department the agency couldn't reach. We scaled it back to 10% once it became clear the metric was picking up client process problems, not agency problems. The numbers have to be fair or the vendor stops trusting the review.
Running the Quarterly Review Conversation
The scorecard is a starting point. The meeting has three parts.
First: present the data with context. A fill rate drop from Q1 to Q2 looks different if a large employer opened a new facility two miles from your plant and is pulling from the same hourly labor pool. An agency worth keeping will flag that kind of market context before the review meeting, not after you raise the number. If yours is consistently making excuses rather than providing real context with evidence, that tells you something about the relationship.
Second: agree on specific targets for next quarter. Don't leave with general language like "we need to do better on retention." Name the number. "We want 90-day retention above 65% in Q3, and we'd like to review placement matches together at the 30-day mark for the first two months." Specific targets create accountability; vague feedback produces the same conversation next quarter.
Third: ask what you could change on your side. This one's underrated. We've had clients whose NCNS rate was partly driven by their own floor practices: workers placed on a mid-shift start with no designated parking, no locker assignment, and a supervisor who wasn't told anyone was coming until 15 minutes before. The agency can prep a candidate for a rough day-one experience. It's still a harder placement than it should be, and the workers who stick know it. Sometimes the scorecard reveals an agency problem. Sometimes it reveals a joint problem. Knowing which is which changes the conversation entirely.
When the Scorecard Says It's Time to Switch
A single bad quarter doesn't warrant a vendor change. Staffing markets shift, and a regional hiring surge or a labor event at a nearby facility can depress performance across every agency working that market. Context matters. Two consecutive quarters below 2.8 on your composite, with no credible explanation and no improvement plan, is a different situation.
Other signals that matter regardless of the composite: compliance misses below 100% in two consecutive quarters, an agency that doesn't share data proactively or consistently resists the scorecard framework, and any situation where you've documented and communicated a specific performance issue and seen zero change in the following quarter.
Switching agencies mid-assignment carries real costs: re-onboarding, worker uncertainty, loss of institutional knowledge about your facility and its quirks. The scorecard doesn't make switching easy; nothing about it should. What it does is take the decision out of the gut-feel category and into something you can defend to your own leadership, document for the next vendor negotiation, and use as a baseline expectation when you bring someone new in.
We build formal review rights into our client agreements using SLA language tied to exactly this kind of quarterly scorecard. The full framework for what to include in a staffing contract before the relationship starts, including the SLA provisions that establish your review rights and performance floors, is in our staffing agency SLA guide. For a deeper look at how each of these metrics is defined and calculated across a full staffing account, the staffing KPI pillar post covers the math and the benchmarks we use across our 27 Georgia accounts. And if you want the KPI tracking template we recommend to clients setting up their first formal vendor review, that's available there.
If you want to see how your current agency stacks up, or you're looking for a vendor who comes to quarterly reviews with their own numbers already prepared, Get Started and we'll walk through what the scorecard would look like for your account.
