OpinionReady

Sampling and reach

Incidence rate: the formula, and how it gets misread

The arithmetic takes one line. The disagreements come from what people put in the denominator, and nobody writes that part down.

A field planning meeting with printed quota sheets on the table

Outline. Each heading below carries one line saying what the section has to establish. Expand each into two to four paragraphs, put at least one number or worked example in the piece that nobody else could publish, then delete this note.

Incidence rate is the first number on every feasibility conversation and the last one anybody agrees on. The formula is trivial; the argument is always about what went underneath the line.

The formula, and the one line of arithmetic

State IR = qualified / screened, then show the same fieldwork producing two different rates under two denominators.

Four denominators that all call themselves incidence

Panel base, profiled base, entered-the-screener, completed-the-screener. Give the typical spread between them.

Why the quoted number is almost always the flattering one

Not dishonesty — the profiled base is what a supplier can compute without fielding. Say when that is legitimate.

Drop-off is not a screen-out, and mixing them inflates IR

Explain the difference and the size of the error it introduces on long screeners.

What to ask before you sign

One question: what did you divide by. A supplier who cannot answer immediately did not build the report.

Recording the real rate so the next quote is better

Observed IR per study is the calibration data that makes later estimates honest. Most buyers never send it back.

Filed under Sampling and reach

Who wrote this

OpinionReady Method Desk — Panel operations and data quality

The people who run the exchange day to day — supply operations, quality review and the payout queue. These notes come out of work we had to do anyway, written down because the same questions keep arriving from buyers and from members.

Written from our own operating record: the screening calls, field estimates and payout runs described here are ones we make on this exchange, not secondhand summaries of research done elsewhere.

More on sampling and reach

Everything on this topic