The monthly review shows two campaigns. One produced 38 positive replies and 24 booked meetings. The other produced 21 and 16. The proposal is to double the first. Before agreeing, follow both cohorts to the stage that matters and check what each number was divided by.
The figures below are invented to show the mechanics. They are not benchmarks and should not be read as typical rates.
Two Cohorts, Counted to the End
Cohort A is a broad list of 2,000 contacts pulled by title and company size. Cohort B is 600 contacts, each reviewed against a written fit standard before sending. Both ran the same four-step sequence, and both have had 45 days since the first send.
| Stage | Cohort A | Cohort B |
|---|---|---|
| Contacts sequenced | 2,000 | 600 |
| Delivered | 1,880 | 582 |
| Any reply | 94 | 35 |
| Positive reply | 38 | 21 |
| Meeting booked | 24 | 16 |
| Meeting held | 17 | 14 |
| Qualified by the account executive | 5 | 8 |
On positive replies and booked meetings, A leads comfortably. Reply rates look similar: 5.0% of delivered for A, 6.0% for B. The separation appears lower down. A holds 17 of its 24 booked meetings and B holds 14 of 16. Of meetings held, 29% of A's qualify against 57% of B's. For every 1,000 delivered contacts, A yields about 2.7 qualified meetings and B about 13.7.
One cost never reaches the outbound dashboard. A's 12 unqualified meetings, at 45 minutes each with preparation, took nine hours of account executive time. B's six took four and a half.
Every Rate Needs Its Denominator
Many arguments about sequence performance are two people quoting the same numerator over different denominators. A's positive replies are 1.9% of contacts sequenced, 2.0% of delivered and 40% of replies received. All three are correct, and they answer different questions: response yield across the sourced cohort, response among accepted deliveries, and the composition of replies. None isolates list or message quality on its own.
So name the denominator every time. Delivered divides by sequenced, and it is a weaker word than it sounds, meaning only that the receiving server accepted the message. Google's sender guidelines for mail to personal Gmail accounts set authentication requirements for all senders and further ones for bulk senders, and meeting them does not promise the inbox. Positive replies divide by delivered, held by booked, and qualified by held, against a definition written before the cohort ran.
Lag and Moving Targets
Qualified meetings arrive weeks after the send. A dashboard organized by calendar month pairs this month's sending with outcomes that mostly belong to last month's, so a team that doubles volume sees activity jump while results appear flat. Group by send date, give every cohort the same maturation window, and label anything younger as immature. The 45 days used here is a planning choice for a short sales motion; set yours from how long your meetings take to book and hold.
Targets move too. If the team was paid on positive replies in one quarter and qualified meetings in the next, or the qualification definition tightened in May, cohorts on either side are not comparable without a note. Record the date of every change to targeting, definition or incentive beside the cohort data.
What Small Counts Can Support
B produced eight qualified meetings from a much smaller cohort, while A produced five. The rate difference matters; reducing it to a difference of three meetings would ignore the unequal denominators. Still, both qualified counts are small. A few classification changes or late meetings can move the estimates substantially, and the cohorts were not randomly assigned.
The numbers support a direction and nothing stronger. What strengthens the case is evidence of mechanism: if most of A's negative replies say the recipient does not own the problem, and A's unqualified meetings fail on the same criterion, targeting becomes a plausible cause to test. A second cohort of each type pointing the same way is a sensible planning bar before moving budget. It remains a judgment, short of statistical proof.
Selection Bias, in Both Directions
Cohort B was hand-reviewed, and reviewers are not neutral. They may have favored accounts that already know the company, or simply the 600 easiest in the market. If so, part of B's advantage belongs to those accounts and will fade on expansion, because the next 600 are the ones reviewers ranked lower.
The more damaging bias runs through reply rate. Replies are a self-selected sample, and what you optimize decides who selects in. A curiosity-led subject line, a low-effort question or a free resource can attract replies from people interested in the resource or question without establishing that they own the buying problem. Reply rates may rise while the share of held meetings that qualify falls. A team measured on replies will do this in good faith and report improvement. Each weak-fit contact has also been spent: that account has now heard from you about something that did not apply to it, and a later, better-aimed approach starts from that memory.
The Decision to Send Less
One bounded experiment is to cut A from 2,000 contacts to 800 next month and expand B from 600 to 900, without abandoning either. If the observed rates held, A would produce two qualified meetings and B twelve: fourteen from 1,700 contacts, against thirteen from 2,600. Total sending falls by about a third.
The rates will not hold exactly, and B's is the likeliest to slip as it reaches past the best-reviewed accounts. That is the test. If B at 900 still qualifies at several times A's rate, keep shifting. If it sinks toward A's, investigate whether the added accounts are weaker fits, review standards changed, or outcomes simply vary. Do not infer market size from that change alone.
Sending less is the wrong call in at least two situations. Early on, when the fit standard is a guess, a broad cohort is how you learn who responds; call it exploration and judge it by what it teaches. And where the market is very large and a short call qualifies cheaply, the arithmetic can favor volume. Either way the check is the same: count to qualified, by send date, with the denominator stated.