OpinionReady

Paying participants

Participation limits and the professional respondent

Caps are sold as a fraud control. They are really a control on how much one person shapes your category data.

A diverse group of people standing together in a circle outdoors

Outline. Each heading below carries one line saying what the section has to establish. Expand each into two to four paragraphs, put at least one number or worked example in the piece that nobody else could publish, then delete this note.

The heaviest respondents are not usually cheating. They are available, and availability is not a sampling criterion anyone chose.

What a cap is actually controlling

Not fraud — concentration. One person answering forty studies in a category shapes it.

Single-source panels hit this hardest

Volume beyond natural reach means reusing the same members, and the result leaves no trace in the data.

The trade-off nobody likes stating

Caps cost the most engaged members income. Say that plainly rather than framing it as protection.

Category caps beat global caps

Two hundred studies a year is fine; twelve in one category is not. Explain why the shape matters more than the count.

Telling a member why they are seeing less

Silence here reads as a punishment. What our dashboard says and why.

Measuring concentration

The number to watch is share of completes in a category held by the top one percent of members.

Filed under Paying participants

Who wrote this

OpinionReady Method Desk — Panel operations and data quality

The people who run the exchange day to day — supply operations, quality review and the payout queue. These notes come out of work we had to do anyway, written down because the same questions keep arriving from buyers and from members.

Written from our own operating record: the screening calls, field estimates and payout runs described here are ones we make on this exchange, not secondhand summaries of research done elsewhere.

More on paying participants

Everything on this topic
  • The hourly rate is the only honest number

    Per-survey pricing makes a worse study look better than a good one, and the panels that lean on it are the ones with the worst data.

    4 min read
  • What a screen-out actually costs

    The line buyers negotiate down is the one participants feel first — and it is also the clearest measurement you have of how well your targeting matches the panel.

    4 min read